Sort a Spark DataFrame
Sort a Spark DataFrame by one or more columns, with each column sorted in ascending order.
- An object coercable to a Spark DataFrame.
- The column(s) to sort by.
Transforming Spark DataFrames
The family of functions prefixed with
sdf_ generally access the Scala
Spark DataFrame API directly, as opposed to the
dplyr interface which
uses Spark SQL. These functions will 'force' any pending SQL in a
dplyr pipeline, such that the resulting
returned will no longer have the attached 'lazy' SQL operations. Note that
the underlying Spark DataFrame does execute its operations lazily, so
that even though the pending set of operations (currently) are not exposed at
the R level, these operations will only be executed when you explicitly
collect() the table.