sdf_with_unique_id

A <code>spark_connection</code>, <code>ml_pipeline</code>, or a <code>tbl_spark</code>.

The name of the column to host the generated IDs.

Add a unique ID column to a Spark DataFrame. The Spark
<code>monotonicallyIncreasingId</code> function is used to produce these and is
guaranteed to produce unique, monotonically increasing ids; however, there
is no guarantee that these IDs will be sequential. The table is persisted
immediately after the column is generated, to ensure that the column is
stable -- otherwise, it can differ across new computations.

R interface to Apache Spark, a fast and general engine for big data
processing, see <http://spark.apache.org>. This package supports connecting to
local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end,
and provides an interface to Spark's built-in machine learning algorithms.

Yitao Li

sparklyr

R Interface to Apache Spark

Javier Luraschi

Kevin Kuo

Kevin Ushey

JJ Allaire

Samuel Macedo

Hossein Falaki

Lu Wang

Andy Zhang

Jozef Hajnala

Maciej Szymkiewicz

Wil Davis

 RStudio

 The Apache Software Foundation

sdf_with_unique_id function

Add a Unique ID Column to a Spark DataFrame — sdf_with_unique_id

Add a Unique ID Column to a Spark DataFrame

sdf_with_unique_id: Add a Unique ID Column to a Spark DataFrame

Description

Usage

Arguments