]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: b730706)
vulkan: apply MUL_MAT_ID subgroup optimization to non-coopmat devices (#15524)
authorRuben Ortlam <redacted>
Sun, 24 Aug 2025 17:36:36 +0000 (19:36 +0200)
committerGitHub <redacted>
Sun, 24 Aug 2025 17:36:36 +0000 (19:36 +0200)
commit043fb27d3808766d8ea8195bbd12359727264402
tree26d9c56cc33681498673811e2f16eb6ec411db96tree
parentb730706a49e576fb882dc34d9966345778b3ab0bcommit | diff
vulkan: apply MUL_MAT_ID subgroup optimization to non-coopmat devices (#15524)

* vulkan: use subgroup function for mul_mat_id shader even without coopmat

* vulkan: fix compile warnings

* vulkan: properly check for subgroup size control and require full subgroups for subgroup mul_mat_id

* vulkan: disable subgroup mul_mat_id on devices with subgroups < 16
ggml/src/ggml-vulkan/ggml-vulkan.cpp diff | blob | history
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm.comp diff | blob | history
ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp diff | blob | history
Packaging of ggml-org/llama.cpp