]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
opencl: add q5_0/q5_1 gemm and gemv kernels for Adreno (llama/24319)
authorshaofeiqi <redacted>
Fri, 12 Jun 2026 04:43:09 +0000 (21:43 -0700)
committerGeorgi Gerganov <redacted>
Mon, 15 Jun 2026 07:33:53 +0000 (10:33 +0300)
commit2dcfd49d59810ab7fa0672e17b96968721ed6a27
treebc47dfb061c48b73cd979d761d403823fdc9a787
parentafd559279c1a6fd484632b86ee6eee5d70ce04a2
opencl: add q5_0/q5_1 gemm and gemv kernels for Adreno (llama/24319)

* opencl: add q5_0 adreno support

* opencl: add q5_1 adreno support

* opencl: cosmetic fix

---------

Co-authored-by: Li He <redacted>
ggml/src/ggml-opencl/CMakeLists.txt
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/cvt.cl
ggml/src/ggml-opencl/kernels/gemm_noshuffle_q5_0_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/gemm_noshuffle_q5_1_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/gemv_noshuffle_q5_0_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/gemv_noshuffle_q5_1_f32.cl [new file with mode: 0644]