generate_metadata

Generate a conformant metadata structure for a versioned dataset

Create, update, read and delete data frames in time versioned, parquet-backed datasets. Inspect how your data frame has changed over time. Run your analysis against multiple versions of your data frame.

Riaz Arbi

dataversionr

Time Versioned Storage of Data Frames

generate_metadata function

<dl><dt>df</dt>
<dd>a data frame to create a dv from</dd>
<dt>destination</dt>
<dd>a local directory path or an arrow SubTreeFileSystem</dd>
<dt>key_cols</dt>
<dd>a character vector of column names that constitute a unique key</dd>
<dt>diffed</dt>
<dd>should we store diffs between each dv version?</dd>
<dt>backup_count</dt>
<dd>how many backups should we store?</dd></dl>

Arguments

Generate metadata — generate_metadata

<dl>

<dt>df</dt>
<dd>a data frame to create a dv from</dd>


<dt>destination</dt>
<dd>a local directory path or an arrow SubTreeFileSystem</dd>


<dt>key_cols</dt>
<dd>a character vector of column names that constitute a unique key</dd>


<dt>diffed</dt>
<dd>should we store diffs between each dv version?</dd>


<dt>backup_count</dt>
<dd>how many backups should we store?</dd>

</dl>

generate_metadata: Generate metadata

Description

Usage

Value

Arguments

Examples