powered by
Spark Submit Task
spark_submit_task(parameters)
List. Command-line parameters passed to spark submit. Use Task parameter variables to set parameters containing information about job runs.
Other Task Objects: email_notifications(), libraries(), new_cluster(), notebook_task(), pipeline_task(), python_wheel_task(), spark_jar_task(), spark_python_task()
email_notifications()
libraries()
new_cluster()
notebook_task()
pipeline_task()
python_wheel_task()
spark_jar_task()
spark_python_task()