set_morphemepiece_cache_dir

<p>Character scalar; a path to a cache directory.</p>

cache_dir

<p>Use this function to override the cache path used by morphemepiece for the
current session. Set the <code>MORPHEMEPIECE_CACHE_DIR</code> environment variable
for a more permanent change.</p>

Tokenize text into morphemes. The morphemepiece algorithm uses a
lookup table to determine the morpheme breakdown of words, and falls back on a
modified wordpiece tokenization algorithm for words not found in the lookup
table.

Jonathan Bratt

morphemepiece

set_morphemepiece_cache_dir: Set a Cache Directory for Morphemepiece

Description

Usage

Arguments

Value