cloud_s3_prep_bulk

<code>cloud_s3_ls</code> returns a dataframe of contents of an S3 folder.
This dataframe has <code>name</code> and <code>type</code> columns. <code>name</code> may be either full
names or short names (depending on <code>full_names</code> parameter of <code>cloud_s3_ls</code>),
but <code>names(name)</code> will always contain full names. This function:<ol>
<li>filters out folders</li>
<li>extracts <code>names(name)</code> into <code>path</code> column.</li>
<li>informs about the size of files that are to be downloaded/read and asks
for confirmation</li>
</ol>

internal

A unified interface for simplifying cloud storage interactions,
including uploading, downloading, reading, and writing files, with functions
for both 'Google Drive' (<https://www.google.com/drive/>) and 'Amazon S3'
(<https://aws.amazon.com/s3/>).

Iaroslav Domin

cloudfs

Streamlined Interface to Interact with Cloud Storage Platforms

Stefan Musch

Michal Czyz

Emmanuel Ugochukwu

Gradient Metrics 

cloud_s3_prep_bulk function

<dl><dt>content</dt>
<dd>(data.frame) Output of <code>cloud_s3_ls()</code></dd>
<dt>what</dt>
<dd>What will be done with content, either "read" or "download".
This affects only how messages will look.</dd>
<dt>safe_size</dt>
<dd>What is considered to be safe size in bytes to download in
bulk. To show additional caution message in case if you accidentally run
bulk reading on a folder with gigabytes of data.</dd>
<dt>quiet</dt>
<dd>All caution messages may be turned off by setting this parameter
to <code>TRUE</code>.</dd></dl>

Arguments

Prepare S3 content dataframe to be used by bulk download/read
functions — cloud_s3_prep_bulk

<dl>

<dt>content</dt>
<dd>(data.frame) Output of <code>cloud_s3_ls()</code></dd>


<dt>what</dt>
<dd>What will be done with content, either "read" or "download".
This affects only how messages will look.</dd>


<dt>safe_size</dt>
<dd>What is considered to be safe size in bytes to download in
bulk. To show additional caution message in case if you accidentally run
bulk reading on a folder with gigabytes of data.</dd>


<dt>quiet</dt>
<dd>All caution messages may be turned off by setting this parameter
to <code>TRUE</code>.</dd>

</dl>

cloud_s3_prep_bulk: Prepare S3 content dataframe to be used by bulk download/read functions

Description

Usage

Value

Arguments