spark_write_parquet

The path to the file. Needs to be accessible from the cluster. Supports: "hdfs://" or "s3n://"

path

Specifies the behavior when data or table already exists.

mode

A list of strings with additional options. See <a href="http://spark.apache.org/docs/latest/sql-programming-guide.html#configuration">http://spark.apache.org/docs/latest/sql-programming-guide.html#configuration</a>.

options


Write a Spark DataFrame to a Parquet file


Provision, connect and interface to Apache Spark from within R.
This package supports connecting to local and remote Apache Spark clusters,
provides a dplyr-compatible back-end, and provides an interface to Spark's
built-in machine learning algorithms.

Javier Luraschi

sparklyr

R Interface to Apache Spark

spark_write_parquet function

A list of strings with additional options. See <a href = 'http://spark.apache.org/docs/latest/sql-programming-guide.html#configuration'>http://spark.apache.org/docs/latest/sql-programming-guide.html#configuration</a>.

spark_write_parquet: Write a Spark DataFrame to a Parquet file

Description

Usage

Arguments

See Also