table_write.shard_table_sink

Provides a parallel execution runtime for R that emphasizes
deterministic memory behavior and efficient handling of large shared inputs.
'shard' enables zero-copy parallel reads via shared/memory-mapped segments,
encourages explicit output buffers to avoid large result aggregation, and
supervises worker processes to mitigate memory drift via controlled recycling.
Diagnostics report peak memory usage, end-of-run memory return, and hidden
copy/materialization events to support reproducible performance benchmarking.

Bradley Buchsbaum

shard

Deterministic, Zero-Copy Parallel Execution for R

table_write.shard_table_sink function

<dl><dt>target</dt>
<dd>A <code>shard_table_sink</code>.</dd>
<dt>rows_or_shard_id</dt>
<dd>Integer shard id used to name the row-group file.</dd>
<dt>data</dt>
<dd>A data.frame matching the sink schema.</dd>
<dt>...</dt>
<dd>Reserved for future extensions.</dd></dl>

Arguments

Write a shard's row-group output — table_write.shard_table_sink

<dl>

<dt>target</dt>
<dd>A <code>shard_table_sink</code>.</dd>


<dt>rows_or_shard_id</dt>
<dd>Integer shard id used to name the row-group file.</dd>


<dt>data</dt>
<dd>A data.frame matching the sink schema.</dd>


<dt>...</dt>
<dd>Reserved for future extensions.</dd>

</dl>

table_write.shard_table_sink: Write a shard's row-group output

Description

Usage

Value

Arguments