Learn R Programming

politeness (version 0.9.4)

getTokenSets: Extracting Tokens from Natural Language

Description

Return tokens (words or POS tags) from natural language.

Usage

getTokenSets(text, parser = c("none", "spacy"), num_mc_cores = 1)

Value

list of compiled POS-tagged items.

Arguments

text

a character vector of texts.

parser

character Name of dependency parser to use.

num_mc_cores

integer Number of cores for parallelization. Default is 1.