]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
vulkan: Add perf logger mode with concurrency (llama/17944)
authorJeff Bolz <redacted>
Fri, 19 Dec 2025 05:36:46 +0000 (23:36 -0600)
committerGeorgi Gerganov <redacted>
Wed, 31 Dec 2025 10:39:43 +0000 (12:39 +0200)
commit8faf01f18dd38daec7750613f95f82d574470133
tree3fcf3091d9abfd453f3276ffa91f8d2a9a732016
parentcdb1e3f3c079faf18caa944d7a996fe99ef758e3
vulkan: Add perf logger mode with concurrency (llama/17944)

This implements a variation of the perf logger where rather than timing each
operation individually with effectively a barrier in between, we put the
timing boundaries where we already synchronize and time the groups of work
that normally overlap. This can be useful to help understand whether
individual operations need to be optimized, or if the group is already running
efficiently.

GGML_VK_PERF_LOGGER_CONCURRENT=1 enables the new mode (when
GGML_VK_PERF_LOGGER is also set).

GGML_VK_SYNC_LOGGER=1 replaces the ENABLE_SYNC_LOGGING compile time switch.
src/ggml-vulkan/ggml-vulkan.cpp