dials (version 1.2.0)

token: Token types

Description

Token types

Usage

token(values = values_token)

values_token

Format

An object of class character of length 12.

Arguments

values

A character string of possible values. See values_token in examples below.

Details

This parameter is used in textrecipes::step_tokenize().

Examples

Run this code
values_token
token()

Run the code above in your browser using DataLab