This function is an internal function called by tokenize().
For common usage, use tokenize() instead.
A data.frame.
A character vector to be tokenized.
Character scalar; path to the system dictionary for 'MeCab'.
Character scalar; path to the user dictionary for 'MeCab'.
Logical; If TRUE, activates partial parsing mode.
Integer value larger than 1.