]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting...
authorMarkus Tavenrath <redacted>
Sun, 8 Sep 2024 19:43:48 +0000 (21:43 +0200)
committerGeorgi Gerganov <redacted>
Fri, 20 Sep 2024 19:03:57 +0000 (22:03 +0300)
commitcbe99d7609b118bb670f79892a8e92a123dc4edf
tree543565307ce0bb7a76fed7d5c3f7f66eb593c767
parent1b8bb6e35bd076474775fc2a139708c681d7eacd
Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. (llama/9118)

* Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early.

* fix compile issues

* Fix issues where the last submit wasn't executed or handled properly.

* remove trailing whitespace

* Repair GGML_VULKAN_CHECK_RESULTS

* Increase submit counter only if actual work has been submitted and increase submit count to 100.

* Fix some nodes are not checked with GGML_VULKAN_CHECK_RESULTS enabled.
src/ggml-vulkan.cpp