serialize_tokens

optional pre-existing types for mapping of tokens

types_reserved

Creates a serialized object of tokens, called by <code><a rd-options="=tokens" href="/link/tokens()?package=quanteda&version=2.1.2&to=%3Dtokens" data-mini-rdoc="=tokens::tokens()">tokens()</a></code>.

internal

tokens

A fast, flexible, and comprehensive framework for
quantitative text analysis in R.  Provides functionality for corpus management,
creating and manipulating tokens and ngrams, exploring keywords in context,
forming and manipulating sparse matrices
of documents by features and feature co-occurrences, analyzing keywords, computing feature similarities and
distances, applying content dictionaries, applying supervised and unsupervised machine learning,
visually representing text and text analyses, and more.

Kenneth Benoit

quanteda

Quantitative Analysis of Textual Data

Kohei Watanabe

Haiyan Wang

Paul Nulty

Adam Obeng

Stefan M<c3><bc>ller

Akitaka Matsuo

Jiong Wei Lua

Jouni Kuha

William Lowe

Christian M<c3><bc>ller

Lori Young

Stuart Soroka

Ian Fellows

European Research Council 

serialize_tokens function

Creates a serialized object of tokens, called by <code><a rd-options='=tokens' href='tokens()'>tokens()</a></code>.

Function to serialize list-of-character tokens — serialize_tokens

Function to serialize list-of-character tokens

serialize_tokens: Function to serialize list-of-character tokens

Description

Usage

Arguments

Value