]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
opencl: add basic support for q5_k (llama/21593)
authorshaofeiqi <redacted>
Sat, 11 Apr 2026 08:46:19 +0000 (01:46 -0700)
committerGeorgi Gerganov <redacted>
Thu, 30 Apr 2026 08:29:06 +0000 (11:29 +0300)
commite0c8e505e995a3936998ca36feacaf0cf1950133
tree0373c38d8c4a400361007edc69e1dcd2ce6f3821
parent34381b01c44c2fc0c40a00e2086fd6318bd7f570
opencl: add basic support for q5_k (llama/21593)

* opencl: add general q5_k mv

* opencl: add flattened Q5_K mv and general Q5_K mm

* opencl: fix Q5_K unit tests
ggml/src/ggml-opencl/CMakeLists.txt
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/cvt.cl
ggml/src/ggml-opencl/kernels/mul_mm_q5_k_f32_l4_lm.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mv_q5_k_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mv_q5_k_f32_flat.cl [new file with mode: 0644]