]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
ggml: add Q1_0 1-bit quantization support (CPU) (#21273)
authorPasha Khosravi <redacted>
Mon, 6 Apr 2026 18:55:21 +0000 (11:55 -0700)
committerGitHub <redacted>
Mon, 6 Apr 2026 18:55:21 +0000 (20:55 +0200)
commit2e1f0a889e19a3922db57452268f4574c35c36e5
tree0506a5b22c714882b795b5acb5466c4e88e1b692
parent506200cf8b5c8419ce97d16dc8c50f4634e21ebe
ggml: add Q1_0 1-bit quantization support (CPU) (#21273)

* ggml: add Q1_0 and Q1_0_g128 1-bit quantization support (CPU)

* add generic fallback for x86

* remove Q1_0 (group size 32)

* rename Q1_0_g128 => Q1_0

* fix Q1_0 LlamaFileType Enum

* Fix trailing spaces; add generic fallback for othre backends

* Apply suggestions from code review

Co-authored-by: Sigbjørn Skjæret <redacted>
* fix /r/n spacing + arch-fallback

---------

Co-authored-by: Sigbjørn Skjæret <redacted>
21 files changed:
ggml/include/ggml.h
ggml/src/ggml-common.h
ggml/src/ggml-cpu/arch-fallback.h
ggml/src/ggml-cpu/arch/arm/quants.c
ggml/src/ggml-cpu/arch/loongarch/quants.c
ggml/src/ggml-cpu/arch/powerpc/quants.c
ggml/src/ggml-cpu/arch/s390/quants.c
ggml/src/ggml-cpu/arch/wasm/quants.c
ggml/src/ggml-cpu/ggml-cpu.c
ggml/src/ggml-cpu/ops.cpp
ggml/src/ggml-cpu/quants.c
ggml/src/ggml-cpu/quants.h
ggml/src/ggml-quants.c
ggml/src/ggml-quants.h
ggml/src/ggml.c
gguf-py/gguf/constants.py
include/llama.h
src/llama-model-loader.cpp
src/llama-quant.cpp
tests/test-quantize-fns.cpp
tools/quantize/quantize.cpp