]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 7a9132f)
CANN: Disable acl_graph for prefill stage (llama/15933)
authorhipudding <redacted>
Thu, 11 Sep 2025 07:59:37 +0000 (15:59 +0800)
committerGeorgi Gerganov <redacted>
Sat, 20 Sep 2025 10:33:50 +0000 (13:33 +0300)
commitdb0cd47d36276a1f0dcae5927039a0c5b3420ca6
tree0f74051006c5411c9c265f45e80c03431f755295tree
parent7a9132fa61a82af1ffc67c9b165c97cff9526c66commit | diff
CANN: Disable acl_graph for prefill stage (llama/15933)

Since the prefill length is not fixed, graphs constructed for the
prefill stage cannot be reused. For this reason, ACL graph
execution is disabled by default during prefill.
src/ggml-cann/ggml-cann.cpp diff | blob | history
Packaging of ggml-org/ggml