]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: apply MUL_MAT_ID subgroup optimization to non-coopmat devices (llama/15524)
authorRuben Ortlam <redacted>
Sun, 24 Aug 2025 17:36:36 +0000 (19:36 +0200)
committerGeorgi Gerganov <redacted>
Sat, 20 Sep 2025 10:42:41 +0000 (13:42 +0300)
commitee11ed42a94d5e46269edaa9063b28754cc47e11
tree85824a73cd85a2cfca7376ba5770c2358beb1e5d
parent85d4d2c875edcb1e850208b4817c8e0d1536911e
vulkan: apply MUL_MAT_ID subgroup optimization to non-coopmat devices (llama/15524)

* vulkan: use subgroup function for mul_mat_id shader even without coopmat

* vulkan: fix compile warnings

* vulkan: properly check for subgroup size control and require full subgroups for subgroup mul_mat_id

* vulkan: disable subgroup mul_mat_id on devices with subgroups < 16
ggml/src/ggml-vulkan/ggml-vulkan.cpp
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm.comp
ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp