spark_install

0th

Percentile

Download and install various versions of Spark

Install versions of Spark for use with local Spark connections (i.e. spark_connect(master = "local")

Usage
spark_install(version = NULL, hadoop_version = NULL, reset = TRUE, logging = "INFO", verbose = interactive())
spark_uninstall(version, hadoop_version)
spark_install_dir()
spark_install_tar(tarfile)
spark_installed_versions()
spark_available_versions()
Arguments
version
Version of Spark to install. See spark_available_versions for a list of supported versions
hadoop_version
Version of Hadoop to install. See spark_available_versions for a list of supported versions
reset
Attempts to reset settings to defaults.
logging
Logging level to configure install. Supported options: "WARN", "INFO"
verbose
Report information as Spark is downloaded / installed
tarfile
Path to TAR file conforming to the pattern spark-###-bin-(hadoop)?### where ### reference spark and hadoop versions respectively.
Value

List with information about the installed version.

Aliases
  • spark_available_versions
  • spark_install
  • spark_install_dir
  • spark_install_tar
  • spark_installed_versions
  • spark_uninstall
Documentation reproduced from package sparklyr, version 0.2.27, License: file LICENSE

Community examples

Looks like there are no examples yet.