sdf-saveload
From sparklyr v0.8.1-9001
by Javier Luraschi
Save / Load a Spark DataFrame
Routines for saving and loading Spark DataFrames.
Usage
sdf_save_table(x, name, overwrite = FALSE, append = FALSE)sdf_load_table(sc, name)
sdf_save_parquet(x, path, overwrite = FALSE, append = FALSE)
sdf_load_parquet(sc, path)
Arguments
- x
A
spark_connection
,ml_pipeline
, or atbl_spark
.- name
The table name to assign to the saved Spark DataFrame.
- overwrite
Boolean; overwrite a pre-existing table of the same name?
- append
Boolean; append to a pre-existing table of the same name?
- sc
A
spark_connection
object.- path
The path where the Spark DataFrame should be saved.
Community examples
Looks like there are no examples yet.