]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: Add perf logger mode with concurrency (llama/17944)
authorJeff Bolz <redacted>
Fri, 19 Dec 2025 05:36:46 +0000 (23:36 -0600)
committerGeorgi Gerganov <redacted>
Wed, 31 Dec 2025 15:52:09 +0000 (17:52 +0200)
commit195d8d0c65d40d96caba980706a3011675745892
tree40257877fb9347dc3b60828d6312644fa8c088d5
parentfea481f41243ba113f7b5fd30e30c1dfe5273e32
vulkan: Add perf logger mode with concurrency (llama/17944)

This implements a variation of the perf logger where rather than timing each
operation individually with effectively a barrier in between, we put the
timing boundaries where we already synchronize and time the groups of work
that normally overlap. This can be useful to help understand whether
individual operations need to be optimized, or if the group is already running
efficiently.

GGML_VK_PERF_LOGGER_CONCURRENT=1 enables the new mode (when
GGML_VK_PERF_LOGGER is also set).

GGML_VK_SYNC_LOGGER=1 replaces the ENABLE_SYNC_LOGGING compile time switch.
ggml/src/ggml-vulkan/ggml-vulkan.cpp