wordpiece_cache_dir

The wordpiece cache directory is a platform- and user-specific path where
wordpiece saves caches (such as a downloaded vocabulary). You can override
the default location in a few ways:<ul>
<li>Option:
<code>wordpiece.dir</code>Use <code><a rd-options="" href="/link/set_wordpiece_cache_dir?package=wordpiece&version=2.1.3" data-mini-rdoc="wordpiece::set_wordpiece_cache_dir">set_wordpiece_cache_dir</a></code> to set a
specific cache directory for this session</li>
<li>Environment:
<code>WORDPIECE_CACHE_DIR</code>Set this environment variable to specify a
wordpiece cache directory for all sessions.</li>
<li>Environment:
<code>R_USER_CACHE_DIR</code>Set this environment variable to specify a cache
directory root for all packages that use the caching system.</li>
</ul>

Apply 'Wordpiece' (<arXiv:1609.08144>) tokenization to input text,
given an appropriate vocabulary. The 'BERT' (<arXiv:1810.04805>) tokenization
conventions are used by default.

Jonathan Bratt

wordpiece

R Implementation of Wordpiece Tokenization

Jon Harmon

Bedford Freeman & Worth Pub Grp LLC DBA Macmillan Learning 

wordpiece_cache_dir function

The wordpiece cache directory is a platform- and user-specific path where
wordpiece saves caches (such as a downloaded vocabulary). You can override
the default location in a few ways:<ul>
<li>Option:
<code>wordpiece.dir</code>Use <code><a rd-options='' href='set_wordpiece_cache_dir'>set_wordpiece_cache_dir</a></code> to set a
specific cache directory for this session</li>
<li>Environment:
<code>WORDPIECE_CACHE_DIR</code>Set this environment variable to specify a
wordpiece cache directory for all sessions.</li>
<li>Environment:
<code>R_USER_CACHE_DIR</code>Set this environment variable to specify a cache
directory root for all packages that use the caching system.</li>
</ul>

wordpiece_cache_dir: Retrieve Directory for wordpiece Cache

Description

Usage

Arguments

Value