]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
opencl: add q5_0/q5_1 gemm and gemv kernels for Adreno (#24319)
authorshaofeiqi <redacted>
Fri, 12 Jun 2026 04:43:09 +0000 (21:43 -0700)
committerGitHub <redacted>
Fri, 12 Jun 2026 04:43:09 +0000 (21:43 -0700)
commitba1df050f3dc7827fc64936b2e24fe499c9f74eb
tree6c99df59e8a5c337568bc8297a664e94703ae869
parent1593d5684d077c07fc788e9527ec1bd52287de7f
opencl: add q5_0/q5_1 gemm and gemv kernels for Adreno (#24319)

* opencl: add q5_0 adreno support

* opencl: add q5_1 adreno support

* opencl: cosmetic fix

---------

Co-authored-by: Li He <redacted>
ggml/src/ggml-opencl/CMakeLists.txt
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/cvt.cl
ggml/src/ggml-opencl/kernels/gemm_noshuffle_q5_0_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/gemm_noshuffle_q5_1_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/gemv_noshuffle_q5_0_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/gemv_noshuffle_q5_1_f32.cl [new file with mode: 0644]