spark_dependency

From sparklyr v1.5.2 by Yitao Li

Define a Spark dependency

Define a Spark dependency consisting of a set of custom JARs and Spark packages.

Usage

spark_dependency(
  jars = NULL,
  packages = NULL,
  initializer = NULL,
  catalog = NULL,
  repositories = NULL,
  ...
)

Arguments

jars: Character vector of full paths to JAR files.
packages: Character vector of Spark packages names.
initializer: Optional callback function called when initializing a connection.
catalog: Optional location where extension JAR files can be downloaded for Livy.
repositories: Character vector of Spark package repositories.
...: Additional optional arguments.

Value

An object of type `spark_dependency`

Documentation reproduced from package sparklyr, version 1.5.2, License: Apache License 2.0 | file LICENSE

Community examples

Looks like there are no examples yet.