spark_write_avro

A Spark DataFrame or dplyr operation

The path to the file. Needs to be accessible from the cluster.
Supports the <samp>"hdfs://"</samp>, <samp>"s3n://"</samp> and <samp>"file://"</samp> protocols.

path

Specifies the behavior when data or table already exists.

mode

A list of strings with additional options. See <a href="http://spark.apache.org/docs/latest/sql-programming-guide.html#configuration">http://spark.apache.org/docs/latest/sql-programming-guide.html#configuration</a>.

options

Serialize a Spark DataFrame to the
<a href="https://parquet.apache.org/">Parquet</a> format.

Load Avro Files into 'Apache Spark' using 'sparklyr'. This
allows to read files from 'Apache Avro' <https://avro.apache.org/>.

Aki Ariga

sparkavro

Load Avro file into 'Apache Spark'

spark_write_avro function

A list of strings with additional options. See <a href='http://spark.apache.org/docs/latest/sql-programming-guide.html#configuration'>http://spark.apache.org/docs/latest/sql-programming-guide.html#configuration</a>.

Serialize a Spark DataFrame to the
<a href='https://parquet.apache.org/'>Parquet</a> format.

spark_write_avro: Write a Spark DataFrame to a Avro file

Description

Usage

Arguments