sparklyr (version 0.6.4)

sdf_with_sequential_id: Add a Sequential ID Column to a Spark DataFrame

Description

Add a sequential ID column to a Spark DataFrame. The Spark zipWithIndex function is used to produce these. This differs from sdf_with_unique_id in that the IDs generated are independent of partitioning.

Usage

sdf_with_sequential_id(x, id = "id", from = 1L)

Arguments

x

An object coercable to a Spark DataFrame (typically, a tbl_spark).

id

The name of the column to host the generated IDs.

from

The starting value of the id column