]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
opencl: Adreno optimization for MoE - MxFP4 (#22301)
authorShawn Gu <redacted>
Sat, 2 May 2026 06:02:24 +0000 (23:02 -0700)
committerGitHub <redacted>
Sat, 2 May 2026 06:02:24 +0000 (23:02 -0700)
commitc5a3bc39b1b0fe56954c6adb99e89b25d5e7b9cb
treec198839c33ad35c3cc6fa5323b27343ce9e4ebeb
parent9dbb372610a912b42ddb6c418947ac5f135564d1
opencl: Adreno optimization for MoE - MxFP4 (#22301)

* MoE Mxfp4 CLC kernel added, router reorder on GPU

* Pass test-backend-ops for MoE mxfp4 Adreno CLC

* remove putenv in llama-model.cpp

* fix indent style and whitespace

* opencl: remove unnecessary headers

* opencl: do not save cl_program objects

* opencl: remove unnecessary assert

* fix precision issue

---------

Co-authored-by: Li He <redacted>
ggml/src/ggml-opencl/CMakeLists.txt
ggml/src/ggml-opencl/ggml-opencl.cpp
ggml/src/ggml-opencl/kernels/cvt.cl
ggml/src/ggml-opencl/kernels/gemm_moe_mxfp4_f32_ns.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/gemv_moe_mxfp4_f32_ns.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/moe_reorder_b.cl [new file with mode: 0644]
ggml/src/ggml-opencl/kernels/moe_sort_by_expert.cl [new file with mode: 0644]