]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: fuse mul_mat+add and mul_mat_id+add_id (llama/16868)
authorJeff Bolz <redacted>
Sat, 1 Nov 2025 05:45:28 +0000 (00:45 -0500)
committerGeorgi Gerganov <redacted>
Sun, 9 Nov 2025 21:38:03 +0000 (23:38 +0200)
commit90be9c9de1bf23418901b4b65d6fe0fca4552b5c
tree15a21de4c7270d2337a61dae54a0d3094b039229
parent7d55fba06f6c85ccafe09c75980c2f5ce23a3cad
vulkan: fuse mul_mat+add and mul_mat_id+add_id (llama/16868)

* vulkan: fuse mul_mat+add and mul_mat_id+add_id

The fusion is only applied for the mat-vec mul paths.

* Apply suggestions from code review

Co-authored-by: Sigbjørn Skjæret <redacted>
* fix 32b build

---------

Co-authored-by: Sigbjørn Skjæret <redacted>
ggml/src/ggml-vulkan/ggml-vulkan.cpp
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_base.glsl
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_nc.comp
ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_p021.comp