sdf_last_index

From sparklyr v1.0.5 by Javier Luraschi

Returns the last index of a Spark DataFrame

Returns the last index of a Spark DataFrame. The Spark mapPartitionsWithIndex function is used to iterate through the last nonempty partition of the RDD to find the last record.

Usage

sdf_last_index(x, id = "id")

Arguments

x: A spark_connection, ml_pipeline, or a tbl_spark.
id: The name of the index column.

Documentation reproduced from package sparklyr, version 1.0.5, License: Apache License 2.0 | file LICENSE

Community examples

Looks like there are no examples yet.

sdf_last_index

Returns the last index of a Spark DataFrame

Usage

Arguments

Aliases

Community examples

Post a new example: