]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
opencl: add optimized q8_0 mm kernel for adreno (llama/18871)
authorshaofeiqi <redacted>
Fri, 30 Jan 2026 18:19:27 +0000 (10:19 -0800)
committerGeorgi Gerganov <redacted>
Sat, 7 Feb 2026 08:37:38 +0000 (10:37 +0200)
commitc5b01b89eda83894f8cfa110750f66aed9806493
tree9621ca84f4689e79667e17ebe86b2ca23baaafde
parent1e7ce7e429e641145ada578a0331ff54e9ee2746
opencl: add optimized q8_0 mm kernel for adreno (llama/18871)

* Add Q8_0 OpenCL kernel

Co-authored-by: yunjie <redacted>
* opencl: fix build for non-adreno

* opencl: refactor q8_0

* opencl: enforce subgroup size of 64 for adreno for q8_0

* For A750 and older generations, subgroup size can be 64 or 128.
  This kernel assumes subgroup size 64.

* opencl: suppress warning when adreno kernels are disabled

---------

Co-authored-by: yunjie <redacted>
Co-authored-by: Li He <redacted>
src/ggml-opencl/CMakeLists.txt
src/ggml-opencl/ggml-opencl.cpp
src/ggml-opencl/kernels/cvt.cl
src/ggml-opencl/kernels/gemv_noshuffle_general_q8_0_f32.cl [new file with mode: 0644]
src/ggml-opencl/kernels/mul_mm_q8_0_f32_8x4.cl [new file with mode: 0644]