]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
vulkan: add `v_dot2_f32_f16` support in matrix-matrix multiplication and Flash Attent...
authorRuben Ortlam <redacted>
Tue, 9 Jun 2026 11:27:04 +0000 (13:27 +0200)
committerGitHub <redacted>
Tue, 9 Jun 2026 11:27:04 +0000 (13:27 +0200)
commitb4e3dc613baa92a3884d4151e3d631395c81934a
tree8f536be0404adc7c9965e7ecc2cac7b3c978ec34
parentae735b13148db250911ce9d07663d1b95474e7b0
vulkan: add `v_dot2_f32_f16` support in matrix-matrix multiplication and Flash Attention (#24123)

* vulkan: add support for valve fp16 dot2 extension

* use macro for dot2 path choice

* properly check for the feature

* add dot_product abstraction to reduce preprocessor branching
ggml/src/ggml-vulkan/ggml-vulkan.cpp
ggml/src/ggml-vulkan/vulkan-shaders/dot_product_funcs.glsl [new file with mode: 0644]
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn.comp
ggml/src/ggml-vulkan/vulkan-shaders/mul_mm.comp
ggml/src/ggml-vulkan/vulkan-shaders/vulkan-shaders-gen.cpp