]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
vulkan: Fuse mul_mat_id+add_id+mul and mul_mat+add+add. (llama/17287)
authorJeff Bolz <redacted>
Sat, 15 Nov 2025 18:54:23 +0000 (12:54 -0600)
committerGeorgi Gerganov <redacted>
Mon, 17 Nov 2025 13:34:43 +0000 (15:34 +0200)
commit7be311daf231d391f54a172ac78ddf0ae023b3ff
tree39499aa28369c89ac491087ea8d307453d01ce5d
parent614af0d750d089b7558e0d3ef26d53c4a527f7fd
vulkan: Fuse mul_mat_id+add_id+mul and mul_mat+add+add. (llama/17287)

These both show up in gpt-oss. Also, cleanup the mul_mat_vec fusion code a bit.
src/ggml-vulkan/ggml-vulkan.cpp
src/ggml-vulkan/vulkan-shaders/mul_mat_vec_base.glsl
src/ggml-vulkan/vulkan-shaders/mul_mat_vec_iface.glsl [new file with mode: 0644]
src/ggml-vulkan/vulkan-shaders/mul_mat_vec_nc.comp
src/ggml-vulkan/vulkan-shaders/mul_mat_vec_p021.comp
tests/test-backend-ops.cpp