ggmlR (version 0.6.1)

dequantize_row_q2_K: Dequantize Row (K-quants)

Description

Converts K-quant quantized data back to float values. K-quants (q2_K through q8_K) provide better quality/size tradeoffs.

Usage

dequantize_row_q2_K(raw_data, n_elements)
dequantize_row_q3_K(raw_data, n_elements)
dequantize_row_q4_K(raw_data, n_elements)
dequantize_row_q5_K(raw_data, n_elements)
dequantize_row_q6_K(raw_data, n_elements)
dequantize_row_q8_K(raw_data, n_elements)

Value

Numeric vector of dequantized values

Arguments

raw_data

Raw vector containing quantized data

n_elements

Number of elements to dequantize

See Also

Other quantization: dequantize_row_iq2_xxs(), dequantize_row_mxfp4(), dequantize_row_q4_0(), dequantize_row_tq1_0(), ggml_quant_block_info(), iq2xs_free_impl(), iq2xs_init_impl(), iq3xs_free_impl(), iq3xs_init_impl(), quantize_iq2_xxs(), quantize_mxfp4(), quantize_q2_K(), quantize_q4_0(), quantize_row_iq3_xxs_ref(), quantize_row_mxfp4_ref(), quantize_row_q2_K_ref(), quantize_row_q4_0_ref(), quantize_row_tq1_0_ref(), quantize_tq1_0()