]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: support softmax/FA batch and broadcast (llama/14449)
authorJeff Bolz <redacted>
Tue, 1 Jul 2025 08:32:56 +0000 (03:32 -0500)
committerGeorgi Gerganov <redacted>
Sat, 12 Jul 2025 16:23:56 +0000 (19:23 +0300)
commit1b3e06a400b3356b6fce528b98601f1257ac40f4
treeb33e45234b762a18641c796efd1ca76b557b406e
parentd1286cf32b1b18219d33b692ee52383c25428e7f
vulkan: support softmax/FA batch and broadcast (llama/14449)
ggml/src/ggml-vulkan/ggml-vulkan.cpp
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn.comp
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn_base.comp
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn_cm1.comp
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn_cm2.comp
ggml/src/ggml-vulkan/vulkan-shaders/flash_attn_split_k_reduce.comp
ggml/src/ggml-vulkan/vulkan-shaders/soft_max.comp