quanteda (version 2.1.2)

split_values: Internal function for special handling of multi-word dictionary values

Description

Internal function for special handling of multi-word dictionary values

Usage

split_values(dict, concatenator_dictionary, concatenator_tokens)

Arguments

dict

a flatten dictionary

concatenator_dictionary

concatenator from a dictionary object

concatenator_tokens

concatenator from a tokens object