]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
overview / pkg / ggml / sources / whisper.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 42aea65)
Add flash attention MMA / Tiles to support MiMo-V2.5 (llama/22812)
authorAesSedai <redacted>
Sat, 9 May 2026 03:28:29 +0000 (20:28 -0700)
committerGeorgi Gerganov <redacted>
Thu, 14 May 2026 18:26:48 +0000 (21:26 +0300)
commit197c62c10b0fd0452a740704cbba3257526df04c
treed5f40c95d4844124f391bda97abbd3fee330f9eetree
parent42aea65eda1b4100bedb42ea1cc7344da9f1054acommit | diff
Add flash attention MMA / Tiles to support MiMo-V2.5 (llama/22812)

* mimo-v2.5: add flash attention mma/tiles for for d_kq=192 d_v=128

* mimo-v2.5: follow (256, 256) fattn templates

* mimo-v2.5: cleanup comments

* mimo-v2.5: further comment cleanup

* mimo-v2.5: address PR feedback
fix GQA handling
check for other dangling 320/576 carveouts and mirror them for 192
Add to backend ops test so new paths are covered
13 files changed:
ggml/src/ggml-cuda/fattn-mma-f16.cuh diff | blob | history
ggml/src/ggml-cuda/fattn-tile.cu diff | blob | history
ggml/src/ggml-cuda/fattn-tile.cuh diff | blob | history
ggml/src/ggml-cuda/fattn.cu diff | blob | history
ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_1-ncols2_16.cu diff | blob | history
ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_1-ncols2_8.cu diff | blob | history
ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_2-ncols2_16.cu diff | blob | history
ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_2-ncols2_8.cu diff | blob | history
ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_16.cu diff | blob | history
ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_8.cu diff | blob | history
ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_8.cu diff | blob | history
ggml/src/ggml-cuda/template-instances/fattn-tile-instance-dkq192-dv128.cu [new file with mode: 0644] blob
ggml/src/ggml-cuda/template-instances/generate_cu_files.py diff | blob | history
Packaging of ggerganov/whisper.cpp