tokenize_test

Test tokenize function (debugging)

Provides R bindings to the 'llama.cpp' library for running large language models.
The package uses a lightweight architecture where the C++ backend library is downloaded
at runtime rather than bundled with the package.
Package features include text generation, reproducible generation, and parallel inference.

Yaosheng Xu

localLLM

Running Local LLMs with 'llama.cpp' Backend

Eddie Yang

tokenize_test function

<dl><dt>model</dt>
<dd>A model object</dd></dl>

Arguments

Test tokenize function (debugging) — tokenize_test

<dl>

<dt>model</dt>
<dd>A model object</dd>

</dl>

tokenize_test: Test tokenize function (debugging)

Description

Usage

Value

Arguments