Learn R Programming

ggmlR (version 0.8.1)

ggml_run: Run a single-cell task on the GGML backend

Description

Validates a ggml_task against ggml_ops_registry, resolves the compute device, invokes the registered engine and returns a ggml_result. This is the dispatch layer: the only place that decides GPU vs CPU. device = "auto" (the task default) uses Vulkan when a GPU is available and CPU otherwise; device = "vulkan" on a machine with no GPU degrades to CPU with a message rather than failing.

Usage

ggml_run(task, backend = NULL, ...)

Value

A ggml_result.

Arguments

task

A ggml_task.

backend

Optional override of task$device: "auto" (default), "vulkan" or "cpu".

...

Additional parameters merged over task$params and passed to the engine.

See Also

ggml_task, ggml_ops_registry