edge_cache_info

Enables R users to run large language models locally using 'GGUF' model files
and the 'llama.cpp' inference engine. Provides a complete R interface for loading models,
generating text completions, and streaming responses in real-time. Supports local
inference without requiring cloud APIs or internet connectivity, ensuring complete
data privacy and control. Based on the 'llama.cpp' project by Georgi Gerganov (2023) <https://github.com/ggml-org/llama.cpp>.

Pawan Rama Mali

edgemodelr

Local Large Language Model Inference Engine

Georgi Gerganov

The ggml authors 

Jeffrey Quesnelle

Bowen Peng

pi6am 

Ivan Yurchenko

Dirk Eddelbuettel

edge_cache_info function

<dl><dt>cache_dir</dt>
<dd>Cache directory path</dd></dl>

Arguments

Cache size information — edge_cache_info

<dl>

<dt>cache_dir</dt>
<dd>Cache directory path</dd>

</dl>

Cache size information

edge_cache_info: Cache size information

Description

Usage

Value

Arguments