]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
sycl : Add DMMV ESIMD Q3_K kernel (#26251)
authorTodd Malsbary <redacted>
Thu, 13 Aug 2026 08:32:36 +0000 (01:32 -0700)
committerGitHub <redacted>
Thu, 13 Aug 2026 08:32:36 +0000 (11:32 +0300)
commit8efbf65dbd55bc2387d9632ce2f3cd66d33b3813
tree0e2575b75eb6d009b57df7ccbedf310b497fc977
parentd415e65a5784bf83c754eaa33a124c1509ba1cd0
sycl : Add DMMV ESIMD Q3_K kernel (#26251)

* Add DMMV Q4_K and Q6_K ESIMD kernels

Configure cmake build with -DGGML_SYCL_ESIMD=ON to enable.

Signed-off-by: Todd Malsbary <redacted>
* Refactor ESIMD kernels to share common code

Signed-off-by: Todd Malsbary <redacted>
* Move control of ESIMD from compile to runtime

Signed-off-by: Todd Malsbary <redacted>
* Use ESIMD by default when available

Signed-off-by: Todd Malsbary <redacted>
* Fix possible error when using ESIMD by default

While not an issue in the current version, this will become an
issue when additional QK ESIMD kernels are added (such as Q2_K).

Signed-off-by: Todd Malsbary <redacted>
* Add explicit unroll to ESIMD kernels

Signed-off-by: Todd Malsbary <redacted>
* Tidy up ESIMD kernels a bit

Signed-off-by: Todd Malsbary <redacted>
* Add DMMV Q3_K ESIMD kernel

Signed-off-by: Todd Malsbary <redacted>
---------

Signed-off-by: Todd Malsbary <redacted>
docs/backend/SYCL.md
ggml/src/ggml-sycl/common.hpp
ggml/src/ggml-sycl/dmmv.cpp
ggml/src/ggml-sycl/esimd.hpp [new file with mode: 0644]
ggml/src/ggml-sycl/ggml-sycl.cpp