Learn R Programming

rtemis (version 1.4.3)

setup_ParquetIngest: Set up a ParquetIngestConfig

Description

Creates the settings ingest() uses to read a Parquet file. Parquet stores its column types, and the only format-specific setting is the reader library.

Usage

setup_ParquetIngest(
  columns = NULL,
  character2factor = TRUE,
  clean_colnames = TRUE,
  remove_duplicates = FALSE,
  reader = "arrow"
)

Value

ParquetIngestConfig object.

Arguments

columns

Optional Named vector: Declared column types, keyed by column name, in the profile/r/v1 vocabulary -- c(Age = "integer"). A column named here is converted to the declared type after reading, replacing the type the reader assigned.

character2factor

Logical: If TRUE, read character columns as factors.

clean_colnames

Logical: If TRUE, normalize column names.

remove_duplicates

Logical: If TRUE, drop rows repeating an earlier row.

reader

Character {"arrow", "nanoparquet"}: Library used to read the file.

Author

EDG

Examples

Run this code
setup_ParquetIngest()

Run the code above in your browser using DataLab