.load_inst_rds

<p>Character scalar; the type of file, like "uncased".</p>

filetype

<p>Integer scalar; The number of tokens used for that file.</p>

n_tokens

internal

Provides data to be used by the wordpiece algorithm in order to
tokenize text into somewhat meaningful chunks. Included vocabularies were
retrieved from
<https://huggingface.co/bert-base-cased/resolve/main/vocab.txt> and
<https://huggingface.co/bert-base-uncased/resolve/main/vocab.txt> and parsed
into an R-friendly format.

Jon Harmon

wordpiece.data

Data for Wordpiece-Style Tokenization

Jonathan Bratt

Bedford Freeman & Worth Pub Grp LLC DBA Macmillan Learning 

Google, Inc 

.load_inst_rds function

Load an RDS from inst Dir — .load_inst_rds

Load an RDS from inst Dir

.load_inst_rds: Load an RDS from inst Dir

Description

Usage

Arguments

Value