]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml-cpu: extend RVV quantization vec dot to higher VLENs (llama/22754)
authorrehan-10xengineer <redacted>
Thu, 4 Jun 2026 05:03:40 +0000 (10:03 +0500)
committerGeorgi Gerganov <redacted>
Mon, 8 Jun 2026 11:36:36 +0000 (14:36 +0300)
commita1a31868870f0900940d27b5c4d426a9938731d4
tree76c1447ea5cd664d3bc2e7a4d16937e9b0d91a6c
parent00a9728de303c399f069dd1b0b7a33689ab3e56a
ggml-cpu: extend RVV quantization vec dot to higher VLENs (llama/22754)

* ggml-cpu: add rvv 512b,1024b impls for iq4_xs

* ggml-cpu: refactor; add rvv 512b, 1024b impls for q6_K, i-quants

* ggml-cpu: refactor; add 512 and 1024 implementations of tq3_s, iq3_xxs, iq2_s, iq2_xs, iq2_xxs

improve iq2_xs impl for rvv 256

Co-authored-by: Rehan Qasim <redacted>
---------

Co-authored-by: taimur-10x <redacted>
Co-authored-by: Rehan Qasim <redacted>
ggml/src/ggml-cpu/arch/riscv/quants.c