sdf_last_index
From sparklyr v1.0.5
by Javier Luraschi
Returns the last index of a Spark DataFrame
Returns the last index of a Spark DataFrame. The Spark
mapPartitionsWithIndex
function is used to iterate
through the last nonempty partition of the RDD to find the last record.
Usage
sdf_last_index(x, id = "id")
Arguments
- x
A
spark_connection
,ml_pipeline
, or atbl_spark
.- id
The name of the index column.
Community examples
Looks like there are no examples yet.