spark_apply

An object (usually a <code>spark_tbl</code>) coercable to a Spark DataFrame.

A function that transforms a data frame partition into a data frame.

The column names for the transformed object, defaults to the
names from the original object.

names

Boolean; should the table be cached into memory?

memory

Column name used to group by data frame partitions.

group_by

Boolean; distribute <code>.libPaths()</code> packages to nodes?

packages

Optional arguments; currently unused.

Applies an R function to a Spark object (typically, a Spark DataFrame).

R interface to Apache Spark, a fast and general engine for big data
processing, see <http://spark.apache.org>. This package supports connecting to
local and remote Apache Spark clusters, provides a 'dplyr' compatible back-end,
and provides an interface to Spark's built-in machine learning algorithms.

spark_apply: Apply an R Function in Spark

Description

Usage

Arguments