]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
SYCL: implement ggml_sycl_pool_vmm (#22862)
authorAlexey Kopytko <redacted>
Tue, 26 May 2026 04:59:00 +0000 (13:59 +0900)
committerGitHub <redacted>
Tue, 26 May 2026 04:59:00 +0000 (07:59 +0300)
commit581d020b122710d19ef7d5a10b96451be0a5d0af
tree337d5e4c0151f244e217d6d392db2388edbf12f9
parent7623de11d94ab84d29f784f845dab19608d52ce6
SYCL: implement ggml_sycl_pool_vmm (#22862)

* SYCL: implement ggml_sycl_pool_vmm

* Add an option to bypass VMM with GGML_SYCL_DISABLE_VMM

* Clean up debugging logging

* document GGML_SYCL_DISABLE_VMM

* Multi-stream MoE optimization

* Revert "Multi-stream MoE optimization"

This reverts commit 938929c3f13a562ec67c59e87cc5d38595444cce.

* Update common.hpp

Co-authored-by: Neo Zhang <redacted>
* Flip GGML_SYCL_DISABLE_VMM to GGML_SYCL_ENABLE_VMM

* add logging for GGML_SYCL_ENABLE_VMM when extension is not available (SYCL_EXT_ONEAPI_VIRTUAL_MEM macro)

* Apply suggestions from code review

Co-authored-by: Alexey Kopytko <redacted>
* Apply suggestion from @sanmai

* Apply suggestion from @sanmai

---------

Co-authored-by: Neo Zhang <redacted>
docs/backend/SYCL.md
ggml/src/ggml-sycl/common.hpp
ggml/src/ggml-sycl/ggml-sycl.cpp