Usage
start_shell(master, spark_home = Sys.getenv("SPARK_HOME"), spark_version = NULL, app_name = "sparklyr", config = list(), extensions = sparklyr::registered_extensions(), jars = NULL, packages = NULL, environment = NULL, shell_args = NULL)
stop_shell(sc)
Arguments
master
Spark cluster url to connect to. Use "local"
to connect to a local
instance of Spark
spark_home
Spark home directory (defaults to SPARK_HOME environment variable)
spark_version
Spark version, if not specified, version taken from SPARK_HOME
app_name
Application name to be used while running in the Spark cluster
config
Named character vector of spark.* options
jars
Paths to Jar files to include
packages
Spark packages to include
environment
Environment variables to set
shell_args
Additional command line arguments for spark_shell