]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: fix rms_norm+mul fusion (llama/14545)
authorJeff Bolz <redacted>
Sun, 6 Jul 2025 08:08:16 +0000 (03:08 -0500)
committerGeorgi Gerganov <redacted>
Sat, 12 Jul 2025 16:23:56 +0000 (19:23 +0300)
commit9d0c408260f597fddb1817fc0f512750606b75fe
treed3dacd97f7e997183b3e95495a13f1854ccc3170
parent3aebb8d5d3c7e67b21c31577d111213a1d116c99
vulkan: fix rms_norm+mul fusion (llama/14545)

The fused operation was grabbing the epsilon value from the wrong place.

Add an env var to disable fusion.

Add some missing checks for supported shapes/types.

Handle fused rms_norm+mul in check_results.
ggml/src/ggml-vulkan/ggml-vulkan.cpp