]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
vulkan: skip all-negative-inf blocks in FA (llama/17186)
authorJeff Bolz <redacted>
Sat, 15 Nov 2025 09:37:25 +0000 (03:37 -0600)
committerGeorgi Gerganov <redacted>
Mon, 17 Nov 2025 13:34:43 +0000 (15:34 +0200)
commitd45e2db4a0b9ad12ac6facf4d238cda3ea4aec98
treea841baf46e03f44ca840925bf79f90593658e973
parent2580cab50bf1c198f2de0a2a7d05dc318fb756fa
vulkan: skip all-negative-inf blocks in FA (llama/17186)
src/ggml-vulkan/ggml-vulkan.cpp
src/ggml-vulkan/vulkan-shaders/flash_attn.comp
src/ggml-vulkan/vulkan-shaders/flash_attn_cm1.comp
src/ggml-vulkan/vulkan-shaders/flash_attn_cm2.comp