]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
vulkan: fuse mul_mat+add and mul_mat_id+add_id (llama/16868)
authorJeff Bolz <redacted>
Sat, 1 Nov 2025 05:45:28 +0000 (00:45 -0500)
committerGeorgi Gerganov <redacted>
Sun, 9 Nov 2025 16:30:22 +0000 (18:30 +0200)
commit87fcc0d464490d5171267ceeaa223634a3fcef4d
treea5e7a6e66ef15b7726050bc2ba52dfd4192ed645
parentba4efa9271e6f8141322918e6d7a44800813f3dd
vulkan: fuse mul_mat+add and mul_mat_id+add_id (llama/16868)

* vulkan: fuse mul_mat+add and mul_mat_id+add_id

The fusion is only applied for the mat-vec mul paths.

* Apply suggestions from code review

Co-authored-by: Sigbjørn Skjæret <redacted>
* fix 32b build

---------

Co-authored-by: Sigbjørn Skjæret <redacted>
src/ggml-vulkan/ggml-vulkan.cpp
src/ggml-vulkan/vulkan-shaders/mul_mat_vec_base.glsl
src/ggml-vulkan/vulkan-shaders/mul_mat_vec_nc.comp
src/ggml-vulkan/vulkan-shaders/mul_mat_vec_p021.comp