init_tokenizers

<p>string giving the locale name to
pass to the stringi functions. If
<code>NULL</code>, the default locale is
selected</p>

locale

<p>This function must be run before annotating text with
the tokenizers backend.</p>

Provides a set of fast tools for converting a textual corpus into a set of normalized
tables. Users may make use of a Python back end with 'spaCy' <https://spacy.io>
or the Java back end 'CoreNLP' <http://stanfordnlp.github.io/CoreNLP/>. A minimal back
end with no external dependencies is also provided. Exposed annotation tasks include
tokenization, part of speech tagging, named entity recognition, entity linking, sentiment
analysis, dependency parsing, coreference resolution, and word embeddings. Summary
statistics regarding token unigram, part of speech tag, and dependency type frequencies
are also included to assist with analyses.

Taylor Arnold

init_tokenizers: Interface for initializing the tokenizers backend

Description

Usage

Arguments

Examples