]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: perf_logger improvements (llama/17672)
authorJeff Bolz <redacted>
Sat, 6 Dec 2025 17:46:46 +0000 (11:46 -0600)
committerGeorgi Gerganov <redacted>
Fri, 12 Dec 2025 15:53:21 +0000 (17:53 +0200)
commit898f876fe2a41b3e786db7f097017ffcc0f05dce
treefe0a59b422ce4178b1eb0b578951b6ac45400fe3
parentebff8f9db90ee9a9754c9d8a51c8bf6650c40157
vulkan: perf_logger improvements (llama/17672)

* vulkan: perf_logger improvements

- Move perf_logger from device to ctx.
- Add an env var to control the frequency we dump the stats. If you set a very
large value, it just dumps when the ctx is destroyed.
- Add a fusion info string to the tracking, only log one item per fused op.
- Fix MUL_MAT_ID flops calculation.

* fix vector sizes
ggml/src/ggml-vulkan/ggml-vulkan.cpp