]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
vulkan: Implement set_tensor_async and the event interfaces (#18047)
authorJeff Bolz <redacted>
Sun, 21 Dec 2025 20:52:09 +0000 (14:52 -0600)
committerGitHub <redacted>
Sun, 21 Dec 2025 20:52:09 +0000 (21:52 +0100)
commite1f15b454fbadfddf8f1ec450bf6d390d9db7adb
tree6f8a7121c8cb20be9a4b211f3db0e3fea34df746
parent0e1ccf15c7b6d05c720551b537857ecf6194d420
vulkan: Implement set_tensor_async and the event interfaces (#18047)

The goal is to enable the async loading code paths in
llama_model_loader::load_all_data, originally from #7896. This works and the
loads themselves are faster, but with host visible vidmem I think the cost of
allocating/mapping vidmem moves and becomes more expensive, and I don't see a
benefit by default. But with GGML_VK_DISABLE_HOST_VISIBLE_VIDMEM=1 I do see a
significant improvement in model loading time.
ggml/src/ggml-vulkan/ggml-vulkan.cpp