LateInteractionEmbedder

<p>Token-level embeddings for late interaction scoring</p>

A lightweight vector database for text retrieval in R with embedded
machine learning models and no external API (Application Programming
Interface) keys. Supports dense and hybrid search, optional HNSW
(Hierarchical Navigable Small World) approximate nearest-neighbor indexing,
faceted filters with ACL (Access Control List) metadata, command-line
tools, and a local dashboard built with 'shiny'. The HNSW method is
described by Malkov and Yashunin (2018) <doi:10.1109/TPAMI.2018.2889473>.

Kwadwo Daddy Nyame Owusu Boakye

VectrixDB

Lightweight Vector Database with Embedded Machine Learning
Models

LateInteractionEmbedder function

<p><div class="r6-fields"></div></p><dl>
<dt><code>dimension</code></dt>
<dd><p>Token embedding dimension</p></dd><p></p><p>
<dt><code>language</code></dt>
<dd><p>Language setting ("en" or "ml")</p></dd></p><p>
</p></dl><p></p>

Public fields


<div class="section" id="public-methods">
<h3>Public methods</h3><p></p><p><ul>
<li><p><a href="/link/LateInteractionEmbedder%24new()?package=VectrixDB&version=1.1.2" data-mini-rdoc="VectrixDB::LateInteractionEmbedder$new()"><code>LateInteractionEmbedder$new()</code></a></p></li>
<li><p><a href="/link/LateInteractionEmbedder%24embed()?package=VectrixDB&version=1.1.2" data-mini-rdoc="VectrixDB::LateInteractionEmbedder$embed()"><code>LateInteractionEmbedder$embed()</code></a></p></li>
<li><p><a href="/link/LateInteractionEmbedder%24score()?package=VectrixDB&version=1.1.2" data-mini-rdoc="VectrixDB::LateInteractionEmbedder$score()"><code>LateInteractionEmbedder$score()</code></a></p></li>
<li><p><a href="/link/LateInteractionEmbedder%24clone()?package=VectrixDB&version=1.1.2" data-mini-rdoc="VectrixDB::LateInteractionEmbedder$clone()"><code>LateInteractionEmbedder$clone()</code></a></p></li>
</ul></p><p></p></div><p><hr>
<a id="method-LateInteractionEmbedder-new"></a></p><div class="section" id="method-new-">
<h3>Method <code>new()</code></h3>
<p>Create a new LateInteractionEmbedder</p><div class="section" id="usage">
<h4>Usage</h4>
<p><div class="r"></div></p><pre><code>LateInteractionEmbedder$new(dimension = 64, language = "en")</code></pre><p></p></div><p></p>
</div><p></p><p><div class="section" id="arguments">
<h4>Arguments</h4>
<p><div class="arguments"></div></p><dl>
<dt><code>dimension</code></dt>
<dd><p>Embedding dimension per token</p></dd></dl></div></p><p>
<dt><code>language</code></dt>
<dd><p>Language behavior ("en" = ASCII-focused, "ml" = Unicode-aware)</p></dd></p><p>
</p><p></p>
<p></p><p></p><p><hr>
<a id="method-LateInteractionEmbedder-embed"></a></p><div class="section" id="method-embed-">
<h3>Method <code><a href="/link/embed()?package=VectrixDB&version=1.1.2" data-mini-rdoc="VectrixDB::embed()">embed()</a></code></h3>
<p>Embed texts to token-level embeddings</p><div class="section" id="usage">
<h4>Usage</h4>
<p><div class="r"></div></p><pre><code>LateInteractionEmbedder$embed(texts)</code></pre><p></p></div><p></p>
</div><p></p><p><div class="section" id="arguments">
<h4>Arguments</h4>
<p><div class="arguments"></div></p><dl>
<dt><code>texts</code></dt>
<dd><p>Character vector of texts</p></dd></dl></div></p><p>
</p><p></p>

<div class="section" id="returns">
<h4>Returns</h4>
<p>List of matrices (each matrix is token embeddings for a document)</p>
</div><p></p><p></p><p><hr>
<a id="method-LateInteractionEmbedder-score"></a></p><div class="section" id="method-score-">
<h3>Method <code>score()</code></h3>
<p>Compute late interaction (MaxSim) score</p><div class="section" id="usage">
<h4>Usage</h4>
<p><div class="r"></div></p><pre><code>LateInteractionEmbedder$score(query_embeddings, doc_embeddings)</code></pre><p></p></div><p></p>
</div><p></p><p><div class="section" id="arguments">
<h4>Arguments</h4>
<p><div class="arguments"></div></p><dl>
<dt><code>query_embeddings</code></dt>
<dd><p>Query token embeddings matrix</p></dd></dl></div></p><p>
<dt><code>doc_embeddings</code></dt>
<dd><p>Document token embeddings matrix</p></dd></p><p>
</p><p></p>

<div class="section" id="returns">
<h4>Returns</h4>
<p>Numeric score</p>
</div><p></p><p></p><p><hr>
<a id="method-LateInteractionEmbedder-clone"></a></p><div class="section" id="method-clone-">
<h3>Method <code>clone()</code></h3>
<p>The objects of this class are cloneable with this method.</p><div class="section" id="usage">
<h4>Usage</h4>
<p><div class="r"></div></p><pre><code>LateInteractionEmbedder$clone(deep = FALSE)</code></pre><p></p></div><p></p>
</div><p></p><p><div class="section" id="arguments">
<h4>Arguments</h4>
<p><div class="arguments"></div></p><dl>
<dt><code>deep</code></dt>
<dd><p>Whether to make a deep clone.</p></dd></dl></div></p><p>
</p><p></p>
<p></p><p>
</p>

Methods

Late Interaction Embedder (Simplified ColBERT-style) — LateInteractionEmbedder

<p><div class="r6-fields"></p><dl>
<dt><code>dimension</code></dt>
<dd><p>Token embedding dimension</p></dd>


<dt><code>language</code></dt>
<dd><p>Language setting ("en" or "ml")</p></dd>


</dl><p></div></p>


<div class='section' id='public-methods'>
<h3>Public methods</h3>

<ul>
<li><p><a href='#method-LateInteractionEmbedder-new'><code>LateInteractionEmbedder$new()</code></a></p></li>
<li><p><a href='#method-LateInteractionEmbedder-embed'><code>LateInteractionEmbedder$embed()</code></a></p></li>
<li><p><a href='#method-LateInteractionEmbedder-score'><code>LateInteractionEmbedder$score()</code></a></p></li>
<li><p><a href='#method-LateInteractionEmbedder-clone'><code>LateInteractionEmbedder$clone()</code></a></p></li>
</ul>

</div><p><hr>
<a id="method-LateInteractionEmbedder-new"></a></p><div class='section' id='method-new-'>
<h3>Method <code>new()</code></h3>
<p>Create a new LateInteractionEmbedder</p><div class='section' id='usage'>
<h4>Usage</h4>
<p><div class="r"></p><pre><code>LateInteractionEmbedder$new(dimension = 64, language = "en")</code></pre><p></div></p>
</div>

<div class='section' id='arguments'>
<h4>Arguments</h4>
<p><div class="arguments"></p><dl>
<dt><code>dimension</code></dt>
<dd><p>Embedding dimension per token</p></dd>


<dt><code>language</code></dt>
<dd><p>Language behavior ("en" = ASCII-focused, "ml" = Unicode-aware)</p></dd>


</dl><p></div></p>
</div>

</div><p><hr>
<a id="method-LateInteractionEmbedder-embed"></a></p><div class='section' id='method-embed-'>
<h3>Method <code><a href='https://rdrr.io/r/stats/embed.html'>embed()</a></code></h3>
<p>Embed texts to token-level embeddings</p><div class='section' id='usage'>
<h4>Usage</h4>
<p><div class="r"></p><pre><code>LateInteractionEmbedder$embed(texts)</code></pre><p></div></p>
</div>

<div class='section' id='arguments'>
<h4>Arguments</h4>
<p><div class="arguments"></p><dl>
<dt><code>texts</code></dt>
<dd><p>Character vector of texts</p></dd>


</dl><p></div></p>
</div>
<div class='section' id='returns'>
<h4>Returns</h4>
<p>List of matrices (each matrix is token embeddings for a document)</p>
</div>

</div><p><hr>
<a id="method-LateInteractionEmbedder-score"></a></p><div class='section' id='method-score-'>
<h3>Method <code>score()</code></h3>
<p>Compute late interaction (MaxSim) score</p><div class='section' id='usage'>
<h4>Usage</h4>
<p><div class="r"></p><pre><code>LateInteractionEmbedder$score(query_embeddings, doc_embeddings)</code></pre><p></div></p>
</div>

<div class='section' id='arguments'>
<h4>Arguments</h4>
<p><div class="arguments"></p><dl>
<dt><code>query_embeddings</code></dt>
<dd><p>Query token embeddings matrix</p></dd>


<dt><code>doc_embeddings</code></dt>
<dd><p>Document token embeddings matrix</p></dd>


</dl><p></div></p>
</div>
<div class='section' id='returns'>
<h4>Returns</h4>
<p>Numeric score</p>
</div>

</div><p><hr>
<a id="method-LateInteractionEmbedder-clone"></a></p><div class='section' id='method-clone-'>
<h3>Method <code>clone()</code></h3>
<p>The objects of this class are cloneable with this method.</p><div class='section' id='usage'>
<h4>Usage</h4>
<p><div class="r"></p><pre><code>LateInteractionEmbedder$clone(deep = FALSE)</code></pre><p></div></p>
</div>

<div class='section' id='arguments'>
<h4>Arguments</h4>
<p><div class="arguments"></p><dl>
<dt><code>deep</code></dt>
<dd><p>Whether to make a deep clone.</p></dd>


</dl><p></div></p>
</div>

</div>


LateInteractionEmbedder: Late Interaction Embedder (Simplified ColBERT-style)

Description

Arguments

Public fields

Methods

Public methods

Method `new()`

Usage

Arguments

Method `embed()`

Usage

Arguments

Returns

Method `score()`

Usage

Arguments

Returns

Method `clone()`

Usage

Arguments

Description

Arguments

Public fields

Methods

Public methods

Method new()

Usage

Arguments

Method embed()

Usage

Arguments

Returns

Method score()

Usage

Arguments

Returns

Method clone()

Usage

Arguments

Method `new()`

Method `embed()`

Method `score()`

Method `clone()`