]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
CANN: Add MROPE and IMROPE support (llama/17401)
authorhipudding <redacted>
Wed, 26 Nov 2025 08:44:19 +0000 (16:44 +0800)
committerGeorgi Gerganov <redacted>
Fri, 12 Dec 2025 15:53:08 +0000 (17:53 +0200)
commitf0c54d47e16065560ead37ef62f6739636256fbf
tree6465670390f858ebb14bd33ccf2513bd49f0d52f
parent208450048c5c456a7e758e90e374b65270e47dec
CANN: Add MROPE and IMROPE support (llama/17401)

* CANN: ROPE supports both MROPE and IMROPE.

1. Optimize the caching logic of rope_cache_init.
2. Add support for mRoPE and i-mRoPE.

Note that on Ascend 910B devices, it is necessary to disable FA
in CLIP and disable NZ-format conversion. These two issues are
still under investigation.

* Resolve review comments
ggml/src/ggml-cann/aclnn_ops.cpp
ggml/src/ggml-cann/common.h
ggml/src/ggml-cann/ggml-cann.cpp