]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
opencl: add basic support for q5_k (#21593)
authorshaofeiqi <redacted>
Sat, 11 Apr 2026 08:46:19 +0000 (01:46 -0700)
committerGitHub <redacted>
Sat, 11 Apr 2026 08:46:19 +0000 (01:46 -0700)
commitaf1127d3c49e41a606bac7c2b3897489aa71b918
tree7d1be41b0f14bf858e0bf02b2cbd405cdfa50ca3
parent865ff06b2ffa2f91f30cbec1f8c73d66cc6642aa
opencl: add basic support for q5_k (#21593)

* opencl: add general q5_k mv

* opencl: add flattened Q5_K mv and general Q5_K mm

* opencl: fix Q5_K unit tests
ggml/src/ggml-opencl/CMakeLists.txt
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/cvt.cl
ggml/src/ggml-opencl/kernels/mul_mm_q5_k_f32_l4_lm.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mv_q5_k_f32.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/mul_mv_q5_k_f32_flat.cl [new file with mode: 0644]