]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml-cpu: add RVV repack GEMM and GEMV for quantization types (llama/19121)
authorTaimur Ahmad <redacted>
Tue, 10 Mar 2026 06:49:52 +0000 (11:49 +0500)
committerGeorgi Gerganov <redacted>
Mon, 16 Mar 2026 11:10:15 +0000 (13:10 +0200)
commitbd64b8af4ddc8fcd01eaa3728af124a4984a1639
treef8166925c7d8b116803ee7d70130585aca8e658b
parentcabe3d95f4403994cc8e6e6fbb58c12e10fb9b88
ggml-cpu: add RVV repack GEMM and GEMV for quantization types (llama/19121)

* ggml-cpu: add rvv ggml_quantize_mat_4x8 for q8_0

Co-authored-by: Rehan Qasim <redacted>
* ggml-cpu: add rvv repacking for iq4_nl

* ggml-cpu: add generic impl for iq4_nl gemm/gemv

* ggml-cpu: add rvv repacking for q8_0

* ggml-cpu: refactor; add rvv repacking for q4_0, q4_K

* ggml-cpu: refactor; add rvv repacking for q2_K

Co-authored-by: Rehan Qasim <redacted>
* ggml-cpu: refactor rvv repack

---------

Co-authored-by: Rehan Qasim <redacted>
ggml/src/ggml-cpu/arch-fallback.h
ggml/src/ggml-cpu/arch/riscv/repack.cpp
ggml/src/ggml-cpu/repack.cpp
ggml/src/ggml-cpu/repack.h