base_dictionary

<p>Data contains English unigrams, with their replacements, points and ids.</p>

datasets

Segmentation of short text sequences - like hashtags - into the
separated words sequence, done with the use of dictionary, which may be
built on custom corpus of texts. Unigram dictionary is used to find most
probable sequence, and n-grams approach is used to determine possible
segmentation given the text corpus.

Oskar Kosch

NUSS

Mixed N-Grams and Unigram Sequence Segmentation

base_dictionary function

<p>A data.frame with four columns: to_search, to_replace, points, id.</p>

base_dictionary: Base dictionary with unigrams

Description

Usage

Arguments

Format

References

Examples