quanteda (version 1.5.2)

tokens_serialize: Function to serialized list-of-character tokens

Description

Creates a serialized object of tokens, called by tokens.

Usage

tokens_serialize(x, types_reserved = NULL, ...)

Arguments

x

a list of character vectors

types_reserved

optional pre-existing types for mapping of tokens

...

additional arguments

Value

a list the serialized tokens found in each text