From: Jeff Bolz <redacted>
Date: Wed, 20 Nov 2024 19:47:36 +0000 (-0600)
Subject: vulkan: predicate max operation in soft_max shaders/soft_max (#10437)
X-Git-Tag: upstream/0.0.4488~342
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=9abe9eeae98b11fa93b82632b264126a010225ff;p=pkg%2Fggml%2Fsources%2Fllama.cpp

vulkan: predicate max operation in soft_max shaders/soft_max (#10437)

Fixes #10434
---

diff --git a/ggml/src/ggml-vulkan/vulkan-shaders/soft_max.comp b/ggml/src/ggml-vulkan/vulkan-shaders/soft_max.comp
index f9727679..6e20b641 100644
--- a/ggml/src/ggml-vulkan/vulkan-shaders/soft_max.comp
+++ b/ggml/src/ggml-vulkan/vulkan-shaders/soft_max.comp
@@ -73,7 +73,9 @@ void soft_max(uint num_iters) {
 
         FLOAT_TYPE v = a * p.scale + slope * b;
 
-        max_val = max(max_val, v);
+        if (col < p.KX) {
+            max_val = max(max_val, v);
+        }
 
         if (idx < DATA_CACHE_SIZE) {
             data_cache[idx] = v;