ggml_get_rel_pos

Gathers relative-position rows for relative-position attention bias.

Provides 'R' bindings to the 'GGML' tensor library for machine
learning, optimized for 'Vulkan' GPU acceleration with a transparent CPU
fallback. The package features a 'Keras'-like sequential API and a
'PyTorch'-style 'autograd' engine for building, training, and deploying
neural networks. Key capabilities include high-performance 5D tensor
operations, 'f16' precision, and efficient quantization. It supports
native 'ONNX' model import (50+ operators) and 'GGUF' weight loading
from the 'llama.cpp' and 'Hugging Face' ecosystems. Designed for
zero-overhead inference via dedicated weight buffering, it integrates
seamlessly as a 'parsnip' engine for 'tidymodels' and provides
first-class learners for the 'mlr3' framework.
See <https://github.com/ggml-org/ggml> for more information about the
underlying library.

Yuri Baramykov

ggmlR

'GGML' Tensor Operations for Machine Learning

ggml_get_rel_pos function

<dl><dt>ctx</dt>
<dd>GGML context</dd>
<dt>a</dt>
<dd>Input tensor</dd>
<dt>qh</dt>
<dd>Query height</dd>
<dt>kh</dt>
<dd>Key height</dd></dl>

Arguments

Get Relative Position (Graph) — ggml_get_rel_pos

<dl>

<dt>ctx</dt>
<dd>GGML context</dd>


<dt>a</dt>
<dd>Input tensor</dd>


<dt>qh</dt>
<dd>Query height</dd>


<dt>kh</dt>
<dd>Key height</dd>

</dl>

ggml_get_rel_pos: Get Relative Position (Graph)

Description

Usage

Value

Arguments