From: Jeff Bolz Date: Fri, 5 Dec 2025 21:08:56 +0000 (-0600) Subject: vulkan: add more num_blocks instantiations in rms_norm (#17701) X-Git-Tag: upstream/0.0.7446~153 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=933414c0b6f21af269bdb4fa2fa1b257b9c0fc53;p=pkg%2Fggml%2Fsources%2Fllama.cpp vulkan: add more num_blocks instantiations in rms_norm (#17701) --- diff --git a/ggml/src/ggml-vulkan/vulkan-shaders/rms_norm.comp b/ggml/src/ggml-vulkan/vulkan-shaders/rms_norm.comp index 3a47949d..9d6d3665 100644 --- a/ggml/src/ggml-vulkan/vulkan-shaders/rms_norm.comp +++ b/ggml/src/ggml-vulkan/vulkan-shaders/rms_norm.comp @@ -131,8 +131,12 @@ void main() { rms_norm(num_blocks); } else if (num_blocks > 16) { rms_norm(32); - } else if (num_blocks > 8) { + } else if (num_blocks > 12) { rms_norm(16); + } else if (num_blocks > 10) { + rms_norm(12); + } else if (num_blocks > 8) { + rms_norm(10); } else if (num_blocks > 4) { rms_norm(8); } else if (num_blocks == 4) {