]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
opencl: add general Q6_K mm and Q4_K mv (llama/19347)
authorlhez <redacted>
Wed, 11 Feb 2026 18:33:13 +0000 (10:33 -0800)
committerGeorgi Gerganov <redacted>
Sun, 15 Feb 2026 19:44:37 +0000 (21:44 +0200)
commit0326fd37dd4170f0264a909c1ab58ec230dee02b
tree18a267f432053a6e695ef3e378446e3f96d10ba8
parentf3e78985bec1b6f5f4f1c4ebd719d31b2b72109c
opencl: add general Q6_K mm and Q4_K mv (llama/19347)

* opencl: add general q6_k mm

* opencl: refine condition for q6_K mm

* opencl: add general q4_K mv

* opencl: fix whitespace
ggml/src/ggml-opencl/CMakeLists.txt
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/mul_mm_q6_k_f32_l4_lm.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mv_q4_k_f32.cl [new file with mode: 0644]