spark_connect(master, spark_home = Sys.getenv("SPARK_HOME"), method = c("shell", "livy"), app_name = "sparklyr", version = NULL, hadoop_version = NULL, config = spark_config(), extensions = sparklyr::registered_extensions())
spark_connection_is_open(sc)
spark_disconnect(sc, ...)
spark_disconnect_all()
"local"
to
connect to a local instance of Spark installed via
spark_install
.SPARK_HOME
environment variable. If
SPARK_HOME
is defined, it will be always be used unless the
version
parameter is specified to force the use of a locally
installed version."shell"
is supported."local"
Spark connections."local"
Spark connections.spark_config
for details.sparklyr::register_extension
will be passed here.spark_connection
.