]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
CANN: Optimize CANN buffer pool memory management (#12875)
authorXinpeng Dou <redacted>
Tue, 15 Apr 2025 02:04:24 +0000 (10:04 +0800)
committerGitHub <redacted>
Tue, 15 Apr 2025 02:04:24 +0000 (10:04 +0800)
commitb0c75ac9f93322b45e3766e149417334b4fd1ed9
tree2a2d74f29d15139f481eb6eeb6887cf97f3a1705
parentd6d2c2ab8c8865784ba9fef37f2b2de3f2134d33
CANN: Optimize CANN buffer pool memory management (#12875)

Multiple optional memory pools are provided for CANN, including VMM,
priority queue-based, and traditional memory pools.
1.When the memory pool is available and GGML_CANN_DISABLE_VMM_POOL
   is not defined, the VMM pool is selected by default.
2.Otherwise, if GGML_CANN_ENABLE_BUF_PRIO_POOL is defined,
   the priority queue-based memory pool is used.
3.If neither condition is met, the default memory pool is used.
ggml/src/ggml-cann/aclnn_ops.cpp
ggml/src/ggml-cann/ggml-cann.cpp