]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
CANN: Add MROPE and IMROPE support (#17401)
authorhipudding <redacted>
Wed, 26 Nov 2025 08:44:19 +0000 (16:44 +0800)
committerGitHub <redacted>
Wed, 26 Nov 2025 08:44:19 +0000 (16:44 +0800)
commiteeb5605de2cda0d9bb24125b36055d4ca175ebe5
tree31ba4afc4495ffaa25229d50947945623d9b656c
parentf3a848a3b11b9418fb5445832aecb7a6e188b2ca
CANN: Add MROPE and IMROPE support (#17401)

* CANN: ROPE supports both MROPE and IMROPE.

1. Optimize the caching logic of rope_cache_init.
2. Add support for mRoPE and i-mRoPE.

Note that on Ascend 910B devices, it is necessary to disable FA
in CLIP and disable NZ-format conversion. These two issues are
still under investigation.

* Resolve review comments
ggml/src/ggml-cann/aclnn_ops.cpp
ggml/src/ggml-cann/common.h
ggml/src/ggml-cann/ggml-cann.cpp