tm (version 0.6-1)

getTokenizers: Tokenizers

Description

Predefined tokenizers.

Usage

getTokenizers()

Arguments

Value

  • A character vector with tokenizers provided by package tm.

See Also

MC_tokenizer and scan_tokenizer.

Examples

getTokenizers()