num_tokens

Used in <code>textrecipes::step_ngram()</code>.

Many models contain tuning parameters (i.e. parameters that
cannot be directly estimated from the data). These tools can be used
to define objects for creating, simulating, or validating values for
such parameters.

Hannah Frick

dials

Tools for Creating Tuning Parameter Values

Max Kuhn

Posit Software, PBC 

num_tokens function

<dl><dt>range</dt>
<dd>A two-element vector holding the defaults for the smallest and
largest possible values, respectively. If a transformation is specified,
these values should be in the transformed units.</dd>
<dt>trans</dt>
<dd>A <code>trans</code> object from the <code>scales</code> package, such as
<code><a href="https://scales.r-lib.org/reference/log_trans.html">scales::log10_trans()</a></code> or <code><a href="https://scales.r-lib.org/reference/reciprocal_trans.html">scales::reciprocal_trans()</a></code>. If not provided,
the default is used which matches the units used in <code>range</code>. If no
transformation, <code>NULL</code>.</dd></dl>

Arguments

Parameter to determine number of tokens in ngram — num_tokens

<dl>

<dt>range</dt>
<dd>A two-element vector holding the defaults for the smallest and
largest possible values, respectively. If a transformation is specified,
these values should be in the transformed units.</dd>


<dt>trans</dt>
<dd>A <code>trans</code> object from the <code>scales</code> package, such as
<code><a href='https://scales.r-lib.org/reference/log_trans.html'>scales::log10_trans()</a></code> or <code><a href='https://scales.r-lib.org/reference/reciprocal_trans.html'>scales::reciprocal_trans()</a></code>. If not provided,
the default is used which matches the units used in <code>range</code>. If no
transformation, <code>NULL</code>.</dd>

</dl>

num_tokens: Parameter to determine number of tokens in ngram

Description

Usage

Arguments

Examples