]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 26af180)
vulkan: fix rms_norm+mul fusion (llama/14545)
authorJeff Bolz <redacted>
Sun, 6 Jul 2025 08:08:16 +0000 (03:08 -0500)
committerGeorgi Gerganov <redacted>
Sat, 12 Jul 2025 13:05:00 +0000 (16:05 +0300)
commitd2f0e7676f6b2f119b3a06012aeae884fe929b34
treecc0a1843d3dcec215a97040ff2d0a81fd531be4etree
parent26af18087718b78fb5d606047d6d760a4cd8bbafcommit | diff
vulkan: fix rms_norm+mul fusion (llama/14545)

The fused operation was grabbing the epsilon value from the wrong place.

Add an env var to disable fusion.

Add some missing checks for supported shapes/types.

Handle fused rms_norm+mul in check_results.
src/ggml-vulkan/ggml-vulkan.cpp diff | blob | history
tests/test-backend-ops.cpp diff | blob | history
Packaging of ggml-org/ggml