]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting...
authorMarkus Tavenrath <redacted>
Sun, 8 Sep 2024 19:43:48 +0000 (21:43 +0200)
committerGitHub <redacted>
Sun, 8 Sep 2024 19:43:48 +0000 (21:43 +0200)
commitdaa9623ab051a8162ae750b150b9522571b55f21
tree6f27ec0e6dc728c4a7710d27aad0369836ed1cab
parente079bffb6678e1b5ded21c719600bedd7175e726
Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. (#9118)

* Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early.

* fix compile issues

* Fix issues where the last submit wasn't executed or handled properly.

* remove trailing whitespace

* Repair GGML_VULKAN_CHECK_RESULTS

* Increase submit counter only if actual work has been submitted and increase submit count to 100.

* Fix some nodes are not checked with GGML_VULKAN_CHECK_RESULTS enabled.
ggml/src/ggml-vulkan.cpp