targets (version 0.11.0)

tar_resources_parquet: Target resources: parquet storage formats

Description

Create the parquet argument of tar_resources()`` to specify optional settings for parquet data frame storage formats powered by the arrowR package. See theformat` argument of tar_target() for details.

Usage

tar_resources_parquet(compression = "snappy", compression_level = NULL)

Arguments

compression

Character of length 1, compression argument of arrow::write_parquet().

compression_level

Numeric of length 1, compression_level argument of arrow::write_parquet().

Value

Object of class "tar_resources_parquet", to be supplied to the parquet argument of tar_resources().

Resources

Functions tar_target() and tar_option_set() each takes an optional resources argument to supply non-default settings of various optional backends for data storage and high-performance computing. The tar_resources() function is a helper to supply those settings in the correct manner. Resources are all-or-nothing: if you specify any resources with tar_target(), all the resources from tar_option_get("resources") are dropped for that target. In other words, if you write tar_option_set(resources = resources_1) and then tar_target(x, my_command(), resources = resources_2), then everything in resources_1 is discarded for target x.

See Also

Other resources: tar_resources_aws(), tar_resources_clustermq(), tar_resources_feather(), tar_resources_fst(), tar_resources_future(), tar_resources_gcp(), tar_resources_qs(), tar_resources_url(), tar_resources()

Examples

# NOT RUN {
# Somewhere in you target script file (usually _targets.R):
tar_target(
  name,
  command(),
  format = "parquet",
  resources = tar_resources(
    parquet = tar_resources_parquet(compression = "lz4")
  )
)
# }