.get_path

<p>Character scalar; the type of file, like "uncased".</p>

filetype

<p>Integer scalar; The number of tokens used for that file.</p>

n_tokens

internal

Provides data to be used by the wordpiece algorithm in order to
tokenize text into somewhat meaningful chunks. Included vocabularies were
retrieved from
<https://huggingface.co/bert-base-cased/resolve/main/vocab.txt> and
<https://huggingface.co/bert-base-uncased/resolve/main/vocab.txt> and parsed
into an R-friendly format.

Jon Harmon

wordpiece.data

Data for Wordpiece-Style Tokenization

Jonathan Bratt

Bedford Freeman & Worth Pub Grp LLC DBA Macmillan Learning 

Google, Inc 

.get_path function

Generate the inst path — .get_path

Generate the inst path

.get_path: Generate the inst path

Description

Usage

Arguments

Value