sdf-saveload

0th

Percentile

Save / Load a Spark DataFrame

Save / load a Spark DataFrame.

Usage
sdf_save_table(x, name, overwrite = FALSE, append = FALSE)
sdf_load_table(sc, name)
sdf_save_parquet(x, path, overwrite = FALSE, append = FALSE)
sdf_load_parquet(sc, path)
Arguments
x
An object coercable to a Spark DataFrame (typically, a tbl_spark).
name
The table name to assign to the saved Spark DataFrame.
overwrite
Boolean; overwrite a pre-existing table of the same name?
append
Boolean; append to a pre-existing table of the same name?
sc
A spark_connection object.
path
The path where the Spark DataFrame should be saved.
Aliases
  • sdf-saveload
  • sdf_load_parquet
  • sdf_load_table
  • sdf_save_parquet
  • sdf_save_table
Documentation reproduced from package sparklyr, version 0.3.4, License: file LICENSE

Community examples

Looks like there are no examples yet.