From: Jeff Bolz Date: Fri, 5 Dec 2025 21:08:56 +0000 (-0600) Subject: vulkan: add more num_blocks instantiations in rms_norm (llama/17701) X-Git-Tag: upstream/1.8.3~179 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=64a3f573e03681b31985878877f5d533bc4d0813;p=pkg%2Fggml%2Fsources%2Fwhisper.cpp vulkan: add more num_blocks instantiations in rms_norm (llama/17701) --- diff --git a/ggml/src/ggml-vulkan/vulkan-shaders/rms_norm.comp b/ggml/src/ggml-vulkan/vulkan-shaders/rms_norm.comp index 3a47949d..9d6d3665 100644 --- a/ggml/src/ggml-vulkan/vulkan-shaders/rms_norm.comp +++ b/ggml/src/ggml-vulkan/vulkan-shaders/rms_norm.comp @@ -131,8 +131,12 @@ void main() { rms_norm(num_blocks); } else if (num_blocks > 16) { rms_norm(32); - } else if (num_blocks > 8) { + } else if (num_blocks > 12) { rms_norm(16); + } else if (num_blocks > 10) { + rms_norm(12); + } else if (num_blocks > 8) { + rms_norm(10); } else if (num_blocks > 4) { rms_norm(8); } else if (num_blocks == 4) {