ngram_tokenizer

Makes an ngram tokenizer function.

A plain 'Rcpp' wrapper for 'MeCab' that can segment Chinese,
Japanese, and Korean text into tokens. The main goal of this package
is to provide an alternative to 'tidytext' using morphological
analysis.

Akiru Kato

gibasa

An Alternative 'Rcpp' Wrapper of 'MeCab'

Shogo Ichinose

Taku Kudo

Jorge Nocedal

Nippon Telegraph and Telephone Corporation 

ngram_tokenizer function

<dl><dt>n</dt>
<dd>Integer.</dd></dl>

Arguments

Ngrams tokenizer — ngram_tokenizer

<dl>

<dt>n</dt>
<dd>Integer.</dd>

</dl>

ngram_tokenizer: Ngrams tokenizer

Description

Usage

Value

Arguments

Examples