gguf_load

Opens a GGUF file and reads its metadata. By default also reads tensor data
into memory; with <code>meta_only = TRUE</code> only the header and key-value
metadata are read (no tensor data is allocated), which is cheap and enough
for inspecting architecture / type fields. Returns an S3 object of class
<code>"gguf"</code> wrapping the internal pointer.

Provides 'R' bindings to the 'GGML' tensor library for machine
learning, optimized for 'Vulkan' GPU acceleration with a transparent CPU
fallback. The package features a 'Keras'-like sequential API and a
'PyTorch'-style 'autograd' engine for building, training, and deploying
neural networks. Key capabilities include high-performance 5D tensor
operations, 'f16' precision, and efficient quantization. It supports
native 'ONNX' model import (50+ operators) and 'GGUF' weight loading
from the 'llama.cpp' and 'Hugging Face' ecosystems. Designed for
zero-overhead inference via dedicated weight buffering, it integrates
seamlessly as a 'parsnip' engine for 'tidymodels' and provides
first-class learners for the 'mlr3' framework.
See <https://github.com/ggml-org/ggml> for more information about the
underlying library.

Yuri Baramykov

ggmlR

'GGML' Tensor Operations for Machine Learning

gguf_load function

<dl><dt>path</dt>
<dd>Path to a .gguf file.</dd>
<dt>meta_only</dt>
<dd>If <code>TRUE</code>, read only the header and metadata without
allocating tensor data. Metadata, tensor names and tensor info remain
available; <code>gguf_tensor_data</code> is not (reload with
<code>meta_only = FALSE</code>). Default <code>FALSE</code>.</dd></dl>

Arguments

Load a GGUF File — gguf_load

<dl>

<dt>path</dt>
<dd>Path to a .gguf file.</dd>


<dt>meta_only</dt>
<dd>If <code>TRUE</code>, read only the header and metadata without
allocating tensor data. Metadata, tensor names and tensor info remain
available; <code>gguf_tensor_data</code> is not (reload with
<code>meta_only = FALSE</code>). Default <code>FALSE</code>.</dd>

</dl>

gguf_load: Load a GGUF File

Description

Usage

Value

Arguments