]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
vulkan: perf_logger improvements (llama/15246)
authorJeff Bolz <redacted>
Thu, 14 Aug 2025 13:38:10 +0000 (08:38 -0500)
committerGeorgi Gerganov <redacted>
Mon, 18 Aug 2025 16:15:25 +0000 (19:15 +0300)
commitc0801bf76f95eb8a2e234a7929b73b752d683034
treeec1afafdc43dae8401dd0fa5e5328171ea9a843b
parentb141fc226b68e4af383101c39da90b54ede98850
vulkan: perf_logger improvements (llama/15246)

* vulkan: perf_logger improvements

- Account for batch dimension in flops calculation.
- Fix how "_VEC" is detected for mat_mul_id.
- Fix "n" dimension for mat_mul_id (in case of broadcasting).
- Include a->type in name.

* use <=mul_mat_vec_max_cols rather than ==1
src/ggml-vulkan/ggml-vulkan.cpp