]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: c89c7dd)
CANN: Add MROPE and IMROPE support (llama/17401)
authorhipudding <redacted>
Wed, 26 Nov 2025 08:44:19 +0000 (16:44 +0800)
committerGeorgi Gerganov <redacted>
Thu, 11 Dec 2025 13:32:45 +0000 (15:32 +0200)
commit563130cac8add8854f47de4cf94ea6592a946768
treed92c76d8823046ec06b0e5063b65b3bf0a34722btree
parentc89c7ddd279a473b7b61a1a1c83da2305577eeedcommit | diff
CANN: Add MROPE and IMROPE support (llama/17401)

* CANN: ROPE supports both MROPE and IMROPE.

1. Optimize the caching logic of rope_cache_init.
2. Add support for mRoPE and i-mRoPE.

Note that on Ascend 910B devices, it is necessary to disable FA
in CLIP and disable NZ-format conversion. These two issues are
still under investigation.

* Resolve review comments
src/ggml-cann/aclnn_ops.cpp diff | blob | history
src/ggml-cann/common.h diff | blob | history
src/ggml-cann/ggml-cann.cpp diff | blob | history
Packaging of ggml-org/ggml