get_long_ids: Get ids in various forms to extract token_ids
Description
Get ids in various forms to extract token_ids
Usage
get_long_ids(..., select = NULL, with_fill = FALSE)
Arguments
...
Either a data.table with the columns doc_id, sentence and token_id, or the output of apply_queries
select
If not null, a character vector for selecting column names
with_fill
If TRUE, include the ids of the fill nodes
Value
A data.table with the columns doc_id, sentence and token_id