sdf-saveload

From sparklyr v0.8.1-9001 by Javier Luraschi

Save / Load a Spark DataFrame

Routines for saving and loading Spark DataFrames.

Usage

sdf_save_table(x, name, overwrite = FALSE, append = FALSE)
sdf_load_table(sc, name)
sdf_save_parquet(x, path, overwrite = FALSE, append = FALSE)
sdf_load_parquet(sc, path)

Arguments

x: A spark_connection, ml_pipeline, or a tbl_spark.
name: The table name to assign to the saved Spark DataFrame.
overwrite: Boolean; overwrite a pre-existing table of the same name?
append: Boolean; append to a pre-existing table of the same name?
sc: A spark_connection object.
path: The path where the Spark DataFrame should be saved.

Documentation reproduced from package sparklyr, version 0.8.1-9001, License: Apache License 2.0 | file LICENSE

Community examples

Looks like there are no examples yet.