]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 8132ca7)
vulkan: Reuse conversion results in prealloc_y (llama/15410)
authorJeff Bolz <redacted>
Thu, 21 Aug 2025 14:55:00 +0000 (09:55 -0500)
committerGeorgi Gerganov <redacted>
Fri, 5 Sep 2025 09:54:00 +0000 (12:54 +0300)
commit960f526105b6514422d36b1ff60800afb95ad9ad
treef2a47f240cd098a71ca8a4a0af7e3842e655dde1tree
parent8132ca7daad86537f6d439b956b00a09d3443c44commit | diff
vulkan: Reuse conversion results in prealloc_y (llama/15410)

* vulkan: Reuse conversion results in prealloc_y

Cache the pipeline and tensor that were most recently used to fill prealloc_y,
and skip the conversion if the current pipeline/tensor match.

* don't use shared pointer for prealloc_y_last_pipeline_used
src/ggml-vulkan/ggml-vulkan.cpp diff | blob | history
tests/test-backend-ops.cpp diff | blob | history
Packaging of ggml-org/ggml