]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting...
authorMarkus Tavenrath <redacted>
Sun, 8 Sep 2024 19:43:48 +0000 (21:43 +0200)
committerGeorgi Gerganov <redacted>
Tue, 24 Sep 2024 16:45:08 +0000 (19:45 +0300)
commitdac89af35796c559d7108becda3404cdba5cfd9c
tree2c64687c08294d04ccd3600965789b495820c89c
parent26225f1fb0d8a00189317830c64edca0b78f17b8
Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. (llama/9118)

* Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early.

* fix compile issues

* Fix issues where the last submit wasn't executed or handled properly.

* remove trailing whitespace

* Repair GGML_VULKAN_CHECK_RESULTS

* Increase submit counter only if actual work has been submitted and increase submit count to 100.

* Fix some nodes are not checked with GGML_VULKAN_CHECK_RESULTS enabled.
ggml/src/ggml-vulkan.cpp