sdf_last_index

0th

Percentile

Returns the last index of a Spark DataFrame

Returns the last index of a Spark DataFrame. The Spark mapPartitionsWithIndex function is used to iterate through the last nonempty partition of the RDD to find the last record.

Usage
sdf_last_index(x, id = "id")
Arguments
x

A spark_connection, ml_pipeline, or a tbl_spark.

id

The name of the index column.

Aliases
  • sdf_last_index
Documentation reproduced from package sparklyr, version 1.0.1, License: Apache License 2.0 | file LICENSE

Community examples

Looks like there are no examples yet.