duckplyr (version 1.2.0)

compute_parquet: Compute results to a Parquet file

Description

This is a generic function that executes a query and stores the results in a Parquet file. For a duckplyr frame, the materialization occurs outside of R. The result is a duckplyr frame that can be used with subsequent dplyr verbs.

Usage

compute_parquet(x, path, ...)
# S3 method for duckplyr_df
compute_parquet(x, path, ..., prudence = NULL, options = NULL)
# S3 method for data.frame
compute_parquet(x, path, ..., prudence = NULL, options = NULL)

Value

A data frame (the class may vary based on the input).

Arguments

x

A data frame or lazy data frame.

path

The path of the Parquet file to create.

...

Additional arguments passed to methods.

prudence

Memory protection, controls if DuckDB may convert intermediate results in DuckDB-managed memory to data frames in R memory.

• "lavish": regardless of size,

• "stingy": never,

• "thrifty": up to a maximum size of 1 million cells.

The default is to inherit from the input. This argument is provided here only for convenience. The same effect can be achieved by forwarding the output to as_duckdb_tibble() with the desired prudence. See vignette("prudence") for more information.

options

A list of additional options to pass to create the Parquet file, see https://duckdb.org/docs/sql/statements/copy.html#parquet-options for details.

See Also

compute_csv(), compute.duckplyr_df(), dplyr::collect()

Examples

library(duckplyr)
df <- data.frame(x = c(1, 2))
df <- mutate(df, y = 2)
path <- tempfile(fileext = ".parquet")
df <- compute_parquet(df, path)
explain(df)