]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
sycl: Add reorder to Q6_K mmvq implementation (llama/13885)
authorNicolò Scipione <redacted>
Mon, 9 Jun 2025 09:47:07 +0000 (11:47 +0200)
committerGeorgi Gerganov <redacted>
Tue, 10 Jun 2025 06:59:25 +0000 (09:59 +0300)
commit2640ba5470abcfb2293856e5e097987472332983
tree21c728811e164ec116254270ede71a3b051294cf
parent22c81e2d909d496c3b167103b9670b469cce4366
sycl: Add reorder to Q6_K mmvq implementation (llama/13885)

* Add Reorder to Q6_K mmvq implementation

* Address PR comments: clean up comments

* Remove unused parameter after refactoring q4_k

* Adding inline to function and removing unnecessary reference to int

---------

Signed-off-by: nscipione <redacted>
src/ggml-sycl/convert.cpp
src/ggml-sycl/dequantize.hpp
src/ggml-sycl/ggml-sycl.cpp
src/ggml-sycl/mmvq.cpp
src/ggml-sycl/quants.hpp
src/ggml-sycl/vecdotq.hpp