]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: dbb7e40)
vulkan: remove the need for the dryrun (llama/16826)
authorJeff Bolz <redacted>
Tue, 4 Nov 2025 19:28:17 +0000 (13:28 -0600)
committerGeorgi Gerganov <redacted>
Sun, 9 Nov 2025 16:30:22 +0000 (18:30 +0200)
commit16161fe49cd08d525fa19bf561a1aef823fd4e99
tree64f4fad48fb6fa780c0aeae5628ca5b21893a0a3tree
parentdbb7e406db1a244c10a05325d6a2179b6eb6e997commit | diff
vulkan: remove the need for the dryrun (llama/16826)

* vulkan: remove the need for the dryrun

Allocate pipelines and descriptor sets when requested.

Reallocate the prealloc buffers when needed, and flush any pending work
before reallocating.

For rms_partials and total_mul_mat_bytes, use the sizes computed the last time
the graph was executed.

* remove dryrun parameters
src/ggml-vulkan/ggml-vulkan.cpp diff | blob | history
Packaging of ggml-org/ggml