This function is an internal function called by tokenize()
.
For common usage, use tokenize()
instead.
A data.frame.
A character vector to be tokenized.
Character scalar; path to the system dictionary for 'MeCab'.
Character scalar; path to the user dictionary for 'MeCab'.
Logical; If TRUE
, activates partial parsing mode.
Integer value larger than 1.