]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
CUDA: generalized (mma) FA, add Volta support (llama/17505)
authorJohannes Gäßler <redacted>
Wed, 3 Dec 2025 15:57:05 +0000 (16:57 +0100)
committerGeorgi Gerganov <redacted>
Fri, 12 Dec 2025 15:53:16 +0000 (17:53 +0200)
commit7adbcafb6c4e0c434cfea9fde9b9c9f2ffed66d6
tree5114f9b8ca477e67f663e3590a239b619f1cee3c
parent4a00f2e3a47237801d3d1b18cbf0c65c6e605345
CUDA: generalized (mma) FA, add Volta support (llama/17505)

* CUDA: generalized (mma) FA, add Volta support

* use struct for MMA FA kernel config

---------

Co-authored-by: Aman Gupta <aman>
ggml/include/ggml.h
ggml/src/ggml-cuda/fattn-common.cuh
ggml/src/ggml-cuda/fattn-mma-f16.cuh
ggml/src/ggml-cuda/fattn-tile.cuh
ggml/src/ggml-cuda/fattn-vec.cuh
ggml/src/ggml-cuda/fattn-wmma-f16.cu
ggml/src/ggml-cuda/fattn-wmma-f16.cuh
ggml/src/ggml-cuda/fattn.cu
ggml/src/ggml-cuda/mma.cuh
ggml/src/ggml-cuda/mmf.cuh