corpus (version 0.9.1)

text_types: Text Type Sets.

Description

Get or measure the set of types (unique token values).

Usage

text_types(x, filter = text_filter(x), collapse = FALSE)
    text_ntype(x, filter = text_filter(x), collapse = FALSE)

Arguments

x

a text or character vector.

filter

a text filter defining the token boundaries and normalization.

collapse

a logical value indicating whether to collapse the aggregation over all rows of the input.

Value

If collapse = FALSE, then text_ntype produces a numeric vector with the same length and names as the input text, with the elements giving the number of units in the corresponding texts. For text_types, the result is a list of character vector with each vector giving the unique types in the corresponding text, ordered according to the sort function.

If collapse = TRUE, then we aggregate over all rows of the input. In this case, text_ntype produces a scalar indicating the number of unique types in x, and text_types produces a character vector with the unique types.

Details

text_ntype counts the number of unique types in each text; text_types returns the set of unique types, as a character vector. Types are determined according to the filter argument.

See Also

text_filter, text_tokens.

Examples

# NOT RUN {
    text <- c("I saw Mr. Jones today.",
              "Split across\na line.",
              "What. Are. You. Doing????",
              "She asked 'do you really mean that?' and I said 'yes.'")

    # count the number of unique types
    text_ntype(text)
    text_ntype(text, collapse = TRUE)

    # get the type sets
    text_types(text)
    text_types(text, collapse = TRUE)
# }