tokenize_dictionary: Separate dictionary values using tokenizer
Description
Apply tokens() to dictionary values to improve pattern matching.
Usage
tokenize_dictionary(dictionary, ...)
Arguments
- dictionary
a dictionary object.
- ...
passed to tokens().