]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 17d22a3)
opencl: add MoE support for q4_k, q5_k, q6_k on Adreno (#23303)
authorshaofeiqi <redacted>
Tue, 19 May 2026 21:29:00 +0000 (14:29 -0700)
committerGitHub <redacted>
Tue, 19 May 2026 21:29:00 +0000 (14:29 -0700)
commitb28a2f372a4a470a90ad10f93654e5dc33e78949
treef718ab9f20c39c77cb53dba34e0588c569019248tree
parent17d22a35b268fe997f0f9551d6e39e576bada7facommit | diff
opencl: add MoE support for q4_k, q5_k, q6_k on Adreno (#23303)

* opencl: add q4_k moe support

* opencl: add q5_k moe support

* opencl: add q6_k moe support

* opencl: adjust format

---------

Co-authored-by: Li He <redacted>
ggml/src/ggml-opencl/CMakeLists.txt diff | blob | history
ggml/src/ggml-opencl/ggml-opencl.cpp diff | blob | history
ggml/src/ggml-opencl/kernels/cvt.cl diff | blob | history
ggml/src/ggml-opencl/kernels/gemm_moe_q4_k_f32_ns.cl [new file with mode: 0644] blob
ggml/src/ggml-opencl/kernels/gemm_moe_q5_k_f32_ns.cl [new file with mode: 0644] blob
ggml/src/ggml-opencl/kernels/gemm_moe_q6_k_f32_ns.cl [new file with mode: 0644] blob
ggml/src/ggml-opencl/kernels/gemv_moe_q4_k_f32_ns.cl [new file with mode: 0644] blob
ggml/src/ggml-opencl/kernels/gemv_moe_q5_k_f32_ns.cl [new file with mode: 0644] blob
ggml/src/ggml-opencl/kernels/gemv_moe_q6_k_f32_ns.cl [new file with mode: 0644] blob
Packaging of ggml-org/llama.cpp