.new_wordpiece_vocabulary: Constructor for Class wordpiece_vocabulary
Description
Constructor for Class wordpiece_vocabulary
Usage
.new_wordpiece_vocabulary(vocab, is_cased)
Arguments
vocab
Character vector of tokens.
is_cased
Logical; whether the vocabulary is cased.
Value
The vocabulary with is_cased attached as an attribute, and the
class wordpiece_vocabulary applied.