Learn R Programming
sparklyr (version 1.4.0)

spark_dependency: Define a Spark dependency

Description

Define a Spark dependency consisting of a set of custom JARs and Spark packages.

Usage

spark_dependency(
  jars = NULL,
  packages = NULL,
  initializer = NULL,
  catalog = NULL,
  repositories = NULL,
  ...
)

Arguments

jars

Character vector of full paths to JAR files.

packages

Character vector of Spark packages names.

initializer

Optional callback function called when initializing a connection.

catalog

Optional location where extension JAR files can be downloaded for Livy.

repositories

Character vector of Spark package repositories.

...

Additional optional arguments.

Value

An object of type `spark_dependency`