]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
vulkan: Reuse conversion results in prealloc_y (llama/15410)
authorJeff Bolz <redacted>
Thu, 21 Aug 2025 14:55:00 +0000 (09:55 -0500)
committerGeorgi Gerganov <redacted>
Sat, 20 Sep 2025 10:42:38 +0000 (13:42 +0300)
commit04d0f9a066029c8993c8706dc4d05f127bb5f73e
treed6a42d4ff8873074f1f4b82b2c5b44538dfa239f
parentc5874bcf42a6f2afe0bc6893c0abca757f631c75
vulkan: Reuse conversion results in prealloc_y (llama/15410)

* vulkan: Reuse conversion results in prealloc_y

Cache the pipeline and tensor that were most recently used to fill prealloc_y,
and skip the conversion if the current pipeline/tensor match.

* don't use shared pointer for prealloc_y_last_pipeline_used
ggml/src/ggml-vulkan/ggml-vulkan.cpp