spark_connect

Spark cluster url to connect to. Use <code>"local"</code> to connect to a local
instance of Spark installed via <code><a rd-options="" href="/link/spark_install?package=sparklyr&version=0.3.0" data-mini-rdoc="sparklyr::spark_install">spark_install</a></code>.

master

Spark home directory (defaults to SPARK_HOME environment variable).
If <code>SPARK_HOME</code> is defined it will be always be used unless the <code>version</code>
paramater is specified to force the use of a locally installed version.

spark_home

of connecting to spark (currently only "shell" is supported, additional
methods may come later)

method

Application name to be used while running in the Spark cluster

app_name

Version of Spark (only applicable for local master)

version

Version of Hadoop (only applicable for local master)

hadoop_version

Configuration for connection (see <code><a rd-options="" href="/link/spark_config?package=sparklyr&version=0.3.0" data-mini-rdoc="sparklyr::spark_config">spark_config</a> for details</code>).

config

Extension packages to enable for this connection. By default will
enable all packages that previously called <code>sparklyr::register_extension</code>.

extensions

Provision, connect and interface to Apache Spark from within R.
This package supports connecting to local and remote Apache Spark clusters,
provides a dplyr-compatible back-end, and provides an interface to Spark's
built-in machine learning algorithms.

Javier Luraschi

sparklyr

R Interface to Apache Spark

spark_connect function

Spark cluster url to connect to. Use <code>"local"</code> to connect to a local
instance of Spark installed via <code><a rd-options='' href='spark_install'>spark_install</a></code>.

Configuration for connection (see <code><a rd-options='' href='spark_config'>spark_config</a> for details</code>).

spark_connect: Connect to Spark

Description

Usage

Arguments

Value

See Also