.useParallelDownload

Internal policy helper for Feature A, separated from the download mechanism so
it can be unit-tested without network access. The parallel path is gated on
the opt-in <code>reproducible.urlRemap</code> being set: if no remap function is set,
it is never used, regardless of <code>reproducible.parallel.streams</code>. When a remap
is set, the path is used only when <code>reproducible.parallel.streams &gt; 1</code> (the
default is <code>48L</code>; set it to <code>1L</code> to disable), the curl and httr2
packages are available, the server advertises <code>Accept-Ranges: bytes</code>, and the
file is larger than <code>reproducible.parallel.threshold</code>. When that gate is not
met, the (potentially network-touching) <code>.probeRange()</code> call is skipped
entirely.

internal

A collection of high-level, machine- and OS-independent tools
for making reproducible and reusable content in R.
The two workhorse functions are 'Cache()' and 'prepInputs()'.
'Cache()' allows for nested caching, is robust to environments and objects
with environments (like functions), and deals with some classes of
file-backed R objects e.g., from 'terra' and 'raster' packages.
Both functions have been developed to be foundational components of data
retrieval and processing in continuous workflow situations. In both functions,
efforts are made to make the first and subsequent calls of functions have
the same result, but faster at subsequent times by way of checksums
and digesting. Several features are still under development, including
cloud storage of cached objects allowing for sharing between users. Several
advanced options are available, see '?reproducibleOptions()'.

Eliot J B

reproducible

Enhance Reproducibility of R Code

Eliot J B McIntire

Alex M Chubaty

Tati Micheletti

Ceres Barros

Ian Eddy

His Majesty the King in Right of Canada, as represented by the Minister of Natural Resources Canada 

.useParallelDownload function

<dl><dt>url</dt>
<dd>The resolved URL.</dd>
<dt>streams</dt>
<dd>Number of parallel streams (<code>reproducible.parallel.streams</code>).</dd>
<dt>threshold</dt>
<dd>Size threshold in bytes.</dd>
<dt>verbose</dt>
<dd>Numeric verbosity level.</dd></dl>

Arguments

Decide whether to use the parallel ranged download path — .useParallelDownload

<dl>

<dt>url</dt>
<dd>The resolved URL.</dd>


<dt>streams</dt>
<dd>Number of parallel streams (<code>reproducible.parallel.streams</code>).</dd>


<dt>threshold</dt>
<dd>Size threshold in bytes.</dd>


<dt>verbose</dt>
<dd>Numeric verbosity level.</dd>

</dl>

.useParallelDownload: Decide whether to use the parallel ranged download path

Description

Usage

Value

Arguments