]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
vulkan: fix rms_norm+mul fusion (#14545)
authorJeff Bolz <redacted>
Sun, 6 Jul 2025 08:08:16 +0000 (03:08 -0500)
committerGitHub <redacted>
Sun, 6 Jul 2025 08:08:16 +0000 (10:08 +0200)
commite592be15756ae546ba87bb5a5250b71248121971
tree01d6c29a5e2065853d93f3fe07fc7e668c96b367
parenta0374a67e2924f2e845cdc59dd67d9a44065a89c
vulkan: fix rms_norm+mul fusion (#14545)

The fused operation was grabbing the epsilon value from the wrong place.

Add an env var to disable fusion.

Add some missing checks for supported shapes/types.

Handle fused rms_norm+mul in check_results.
ggml/src/ggml-vulkan/ggml-vulkan.cpp
tests/test-backend-ops.cpp