h2o.tokenize

0th

Percentile

Tokenize String

h2o.tokenize is similar to h2o.strsplit, the difference between them is that h2o.tokenize will store the tokenized text into a single column making it easier for additional processing (filtering stop words, word2vec algo, ...).

Usage
h2o.tokenize(x, split)
Arguments
x

The column or columns whose strings to tokenize.

split

The regular expression to split on.

Value

An H2OFrame with a single column representing the tokenized Strings. Original rows of the input DF are separated by NA.

Aliases
  • h2o.tokenize
Examples
# NOT RUN {
library(h2o)
h2o.init()
string_to_tokenize <- as.h2o("Split at every character and tokenize.")
tokenize_string <- h2o.tokenize(as.character(string_to_tokenize), "")
# }
Documentation reproduced from package h2o, version 3.26.0.2, License: Apache License (== 2.0)

Community examples

Looks like there are no examples yet.