Learn R Programming

ggmlR (version 0.6.1)

GGML_TYPE_F32: GGML Data Types

Description

Constants representing different data types supported by GGML.

Usage

GGML_TYPE_F32

GGML_TYPE_F16

GGML_TYPE_Q4_0

GGML_TYPE_Q4_1

GGML_TYPE_Q8_0

GGML_TYPE_I32

GGML_TYPE_BF16

Arguments

Value

An integer constant representing a GGML data type

Format

Integer constants

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

An object of class integer of length 1.

Details

  • GGML_TYPE_F32: 32-bit floating point (default)

  • GGML_TYPE_F16: 16-bit floating point (half precision)

  • GGML_TYPE_Q4_0: 4-bit quantization type 0

  • GGML_TYPE_Q4_1: 4-bit quantization type 1

  • GGML_TYPE_Q8_0: 8-bit quantization type 0

  • GGML_TYPE_I32: 32-bit integer

  • GGML_TYPE_BF16: 16-bit brain float (bfloat16)

Examples

Run this code
# \donttest{
GGML_TYPE_F32
GGML_TYPE_F16
GGML_TYPE_I32
# }

Run the code above in your browser using DataLab