]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml-cpu: add RVV vec dot kernels for quantization types (llama/18859)
authorrehan-10xengineer <redacted>
Fri, 13 Mar 2026 15:36:04 +0000 (20:36 +0500)
committerGeorgi Gerganov <redacted>
Mon, 16 Mar 2026 11:10:15 +0000 (13:10 +0200)
commit5905e8708f6ef43ceb8dc99197524c4deadeb5b0
treeb444e575f5d25e5f39aeb69c034706b5addf2c40
parent9bfa81d262b67a61b67224dbc578aaca06e01078
ggml-cpu: add RVV vec dot kernels for quantization types (llama/18859)

* ggml-cpu: add rvv quantize_row_q8_K kernel

Co-authored-by: Rehan Qasim <redacted>
* ggml-cpu: add rvv vec_dot for iq4_nl, mxfp4, iq2_xxs

Co-authored-by: Rehan Qasim <redacted>
* ggml-cpu: add rvv vec_dot for iq4_xs, refactor

* ggml-cpu: remove ifunc for rvv vec dot

* ggml-cpu: add vec_dot for iq2_xs, iq3_xxs

Co-authored-by: Rehan Qasim <redacted>
* ggml-cpu: refactor quants.c

---------

Co-authored-by: taimur-10x <redacted>
Co-authored-by: Rehan Qasim <redacted>
Co-authored-by: Rehan Qasim <redacted>
ggml/src/ggml-cpu/arch-fallback.h
ggml/src/ggml-cpu/arch/riscv/quants.c