]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
ggml-cpu: add RVV vec dot kernels for quantization types (llama/18784)
authorTaimur Ahmad <redacted>
Fri, 20 Feb 2026 11:30:07 +0000 (16:30 +0500)
committerGeorgi Gerganov <redacted>
Wed, 25 Feb 2026 10:32:13 +0000 (12:32 +0200)
commitfead65cefe76a46878847e733d61795c5cac76b7
tree57d4d600c1c6224d8ff1bc6d66883c7df87db82b
parentd4ac481d64f4118074a990a3507ca90ef4dbb4d9
ggml-cpu: add RVV vec dot kernels for quantization types (llama/18784)

* ggml-cpu: add rvv vec_dot for iq2_s

Co-authored-by: Rehan Qasim <redacted>
* ggml-cpu: add rvv vec_dot for iq3_s

Co-authored-by: Rehan Qasim <redacted>
* ggml-cpu: add rvv vec_dot for tq1_0, tq2_0

Co-authored-by: Rehan Qasim <redacted>
ggml-cpu: add rvv vec_dot for tq1_0, tq2_0

* ggml-cpu: add rvv vec_dot for iq1_s, iq1_m

Co-authored-by: Rehan Qasim <redacted>
* ggml-cpu: add vlen switch for rvv vec_dot

---------

Co-authored-by: Rehan Qasim <redacted>
src/ggml-cpu/arch-fallback.h
src/ggml-cpu/arch/riscv/quants.c