]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: f3a848a)
CANN: Add MROPE and IMROPE support (#17401)
authorhipudding <redacted>
Wed, 26 Nov 2025 08:44:19 +0000 (16:44 +0800)
committerGitHub <redacted>
Wed, 26 Nov 2025 08:44:19 +0000 (16:44 +0800)
commiteeb5605de2cda0d9bb24125b36055d4ca175ebe5
tree31ba4afc4495ffaa25229d50947945623d9b656ctree
parentf3a848a3b11b9418fb5445832aecb7a6e188b2cacommit | diff
CANN: Add MROPE and IMROPE support (#17401)

* CANN: ROPE supports both MROPE and IMROPE.

1. Optimize the caching logic of rope_cache_init.
2. Add support for mRoPE and i-mRoPE.

Note that on Ascend 910B devices, it is necessary to disable FA
in CLIP and disable NZ-format conversion. These two issues are
still under investigation.

* Resolve review comments
ggml/src/ggml-cann/aclnn_ops.cpp diff | blob | history
ggml/src/ggml-cann/common.h diff | blob | history
ggml/src/ggml-cann/ggml-cann.cpp diff | blob | history
Packaging of ggml-org/llama.cpp