]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: use flops instead of weight tensor size for submission heuristic (llama/25005)
authorRuben Ortlam <redacted>
Mon, 29 Jun 2026 13:24:44 +0000 (15:24 +0200)
committerGeorgi Gerganov <redacted>
Fri, 10 Jul 2026 10:06:42 +0000 (13:06 +0300)
commitba36235565fedea66eab9aac5f33ecef54d80c4f
tree01a448cddc0f59b854acc72d4642773e176844c5
parent5f51daf5164f04121bea16a7c0ec0f4de64f9370
vulkan: use flops instead of weight tensor size for submission heuristic (llama/25005)

* vulkan: extract flops calculation into function

* use flops instead of matmul src0 tensor size for submission threshold

* use unsigned ints
ggml/src/ggml-vulkan/ggml-vulkan.cpp