From: Jeff Bolz <redacted>
Date: Fri, 5 Dec 2025 21:08:56 +0000 (-0600)
Subject: vulkan: add more num_blocks instantiations in rms_norm (llama/17701)
X-Git-Tag: upstream/0.9.4.395~56
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=2279af4bfa4b7b0e698ae9a34860a67a44aab0cd;p=pkg%2Fggml%2Fsources%2Fggml

vulkan: add more num_blocks instantiations in rms_norm (llama/17701)
---

diff --git a/src/ggml-vulkan/vulkan-shaders/rms_norm.comp b/src/ggml-vulkan/vulkan-shaders/rms_norm.comp
index 3a47949d..9d6d3665 100644
--- a/src/ggml-vulkan/vulkan-shaders/rms_norm.comp
+++ b/src/ggml-vulkan/vulkan-shaders/rms_norm.comp
@@ -131,8 +131,12 @@ void main() {
         rms_norm(num_blocks);
     } else if (num_blocks > 16) {
         rms_norm(32);
-    } else if (num_blocks > 8) {
+    } else if (num_blocks > 12) {
         rms_norm(16);
+    } else if (num_blocks > 10) {
+        rms_norm(12);
+    } else if (num_blocks > 8) {
+        rms_norm(10);
     } else if (num_blocks > 4) {
         rms_norm(8);
     } else if (num_blocks == 4) {