styler (version 0.0-8)

create_tokens: Create a terminal token

Description

Creates a terminal token represented as (a row of) a parse table.

Usage

create_tokens(tokens, texts, lag_newlines = 0, spaces = 0, pos_ids, parents,
  token_before = NA, token_after = NA, indention_ref_ids = NA,
  indents = 0)

Arguments

tokens

Character vector with tokens to create.

texts

Character vector with texts of the token to create.

lag_newlines

Character vector with lag_newlines corresponding to the tokens.

spaces

Character vector with spaces corresponding to the tokens.

pos_ids

Character vector with positional id corresponding to the tokens.

parents

Vector with id corresponding to the parent of the tokens we want to create.

token_before

Character vector corresponding to the columns token_before.

token_after

Character vector corresponding to the columns token_after.

indention_ref_ids

Character vector with indention ref ids corresponding to the tokens.

indents

Vector with indents corresponding to the tokens.

See Also

Other token creators: create_pos_ids, validate_new_pos_ids