]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml: add Q1_0 1-bit quantization support (CPU) (llama/21273)
authorPasha Khosravi <redacted>
Mon, 6 Apr 2026 18:55:21 +0000 (11:55 -0700)
committerGeorgi Gerganov <redacted>
Thu, 30 Apr 2026 08:29:01 +0000 (11:29 +0300)
commit0c2fbd4703a7a64a71dc07e60a17d89dac81d57b
treeb7f43ca68c75a470005862ca0145060c7aca53b1
parent7b19b94c5dc822a21bdb2e574ece4a7b2316c436
ggml: add Q1_0 1-bit quantization support (CPU) (llama/21273)

* ggml: add Q1_0 and Q1_0_g128 1-bit quantization support (CPU)

* add generic fallback for x86

* remove Q1_0 (group size 32)

* rename Q1_0_g128 => Q1_0

* fix Q1_0 LlamaFileType Enum

* Fix trailing spaces; add generic fallback for othre backends

* Apply suggestions from code review

Co-authored-by: Sigbjørn Skjæret <redacted>
* fix /r/n spacing + arch-fallback

---------

Co-authored-by: Sigbjørn Skjæret <redacted>
15 files changed:
ggml/include/ggml.h
ggml/src/ggml-common.h
ggml/src/ggml-cpu/arch-fallback.h
ggml/src/ggml-cpu/arch/arm/quants.c
ggml/src/ggml-cpu/arch/loongarch/quants.c
ggml/src/ggml-cpu/arch/powerpc/quants.c
ggml/src/ggml-cpu/arch/s390/quants.c
ggml/src/ggml-cpu/arch/wasm/quants.c
ggml/src/ggml-cpu/ggml-cpu.c
ggml/src/ggml-cpu/ops.cpp
ggml/src/ggml-cpu/quants.c
ggml/src/ggml-cpu/quants.h
ggml/src/ggml-quants.c
ggml/src/ggml-quants.h
ggml/src/ggml.c