]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
vulkan: Implement topk_moe fused shader, ported from CUDA (#16641)
authorJeff Bolz <redacted>
Sat, 18 Oct 2025 10:22:57 +0000 (05:22 -0500)
committerGitHub <redacted>
Sat, 18 Oct 2025 10:22:57 +0000 (12:22 +0200)
commite56abd2098dd2e2b0804691b93c13b48ae421627
tree0b672f335d2639d91c973b916a65ecb3b8c654e3
parent38355c6c8e43204e11a22daa7483082c0ff01e71
vulkan: Implement topk_moe fused shader, ported from CUDA (#16641)

This is similar to the CUDA shader from #16130, but doesn't use shared memory
and handles different subgroup sizes.
ggml/src/ggml-impl.h
ggml/src/ggml-vulkan/ggml-vulkan.cpp
ggml/src/ggml-vulkan/vulkan-shaders/topk_moe.comp [new file with mode: 0644]
ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp