ml_saveload

0th

Percentile

Save / Load a Spark ML Model Fit

Save / load a ml_model fit.

Usage
ml_load(sc, file, meta = ml_load_meta(file))

ml_save(model, file, meta = ml_save_meta(model, file))

Arguments
sc

A spark_connection.

file

The path where the Spark model should be serialized / deserialized.

meta

The path where the R metadata should be serialized / deserialized. Currently, this must be a local filesystem path. Alternatively, this can be an R function that saves / loads the metadata object.

model

A ml_model fit.

Details

These functions are currently experimental and not yet ready for production use. Unfortunately, the training summary information for regression fits (linear, logistic, generalized) are currently not serialized as part of the model fit, and so model fits recovered through ml_load will not work with e.g. fitted, residuals, and so on. Such fits should still be suitable for generating predictions with new data, however.

Aliases
  • ml_saveload
  • ml_load
  • ml_save
Documentation reproduced from package sparklyr, version 0.6.3, License: Apache License 2.0 | file LICENSE

Community examples

Looks like there are no examples yet.