]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
vulkan: apply MUL_MAT_ID subgroup optimization to non-coopmat devices (llama/15524)
authorRuben Ortlam <redacted>
Sun, 24 Aug 2025 17:36:36 +0000 (19:36 +0200)
committerGeorgi Gerganov <redacted>
Fri, 5 Sep 2025 09:54:03 +0000 (12:54 +0300)
commitb7719fd5f3edb3a52653a4cfbb4750b67d80f302
tree43110a5cf2a7436523b68bfd18a53cd194d5efd9
parent11333c210314f9458f677fa2dde0fd63207c5a74
vulkan: apply MUL_MAT_ID subgroup optimization to non-coopmat devices (llama/15524)

* vulkan: use subgroup function for mul_mat_id shader even without coopmat

* vulkan: fix compile warnings

* vulkan: properly check for subgroup size control and require full subgroups for subgroup mul_mat_id

* vulkan: disable subgroup mul_mat_id on devices with subgroups < 16
src/ggml-vulkan/ggml-vulkan.cpp
src/ggml-vulkan/vulkan-shaders/mul_mm.comp
src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp