]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
opencl: add q4_K gemm and gemv kernels for Adreno (llama/20919)
authorshaofeiqi <redacted>
Mon, 30 Mar 2026 19:19:16 +0000 (12:19 -0700)
committerGeorgi Gerganov <redacted>
Thu, 30 Apr 2026 08:28:57 +0000 (11:28 +0300)
commit6ac5a50005e7080d1c1b293c8e753ea135a9f325
treeb67ddd6bb0fd1998fc2df65ff69ef5547b24f528
parent75b9543856158561584afe59772713ded1e82e95
opencl: add q4_K gemm and gemv kernels for Adreno (llama/20919)

* opencl: add q4_K gemm and gemv kernels for Adreno

* opencl: fix whitespace

* opencl: add workarounds for compiler bugs on older devices

* opencl: handle fp16 denorm on X Elite

* opencl: fix kernel build error

* opencl: fix whitespace

* opencl: make q4_K cvt kernels signature consistent

---------

Co-authored-by: Li He <redacted>
ggml/src/ggml-opencl/CMakeLists.txt
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/cvt.cl
ggml/src/ggml-opencl/kernels/gemm_noshuffle_q4_k_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/gemv_noshuffle_q4_k_f32.cl [new file with mode: 0644]