git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit

overview / pkg / ggml / sources / whisper.cpp / commit

author	Johannes Gäßler <redacted>
	Sun, 2 Feb 2025 18:31:09 +0000 (19:31 +0100)
committer	Georgi Gerganov <redacted>
	Mon, 3 Feb 2025 20:00:57 +0000 (22:00 +0200)
commit	f8a831779e8f12253056b1f50f988f67f62f3b6e
tree	049ec1192b9d91251c53975a0e58677bff717ee8	tree
parent	85451e3612c976f4fa52c3e84816c3118a2a4928	commit \| diff

CUDA: use mma PTX instructions for FlashAttention (llama/11583)

* CUDA: use mma PTX instructions for FlashAttention

* __shfl_sync workaround for movmatrix

* add __shfl_sync to HIP

Co-authored-by: Diego Devesa <redacted>

28 files changed:

ggml/include/ggml.h		diff \| blob \| history
ggml/src/ggml-cuda/CMakeLists.txt		diff \| blob \| history
ggml/src/ggml-cuda/common.cuh		diff \| blob \| history
ggml/src/ggml-cuda/fattn-common.cuh		diff \| blob \| history
ggml/src/ggml-cuda/fattn-mma-f16.cuh	[new file with mode: 0644]	blob
ggml/src/ggml-cuda/fattn-tile-f16.cu		diff \| blob \| history
ggml/src/ggml-cuda/fattn-tile-f32.cu		diff \| blob \| history
ggml/src/ggml-cuda/fattn-vec-f16.cuh		diff \| blob \| history
ggml/src/ggml-cuda/fattn-vec-f32.cuh		diff \| blob \| history
ggml/src/ggml-cuda/fattn-wmma-f16.cu	[new file with mode: 0644]	blob
ggml/src/ggml-cuda/fattn-wmma-f16.cuh		diff \| blob \| history
ggml/src/ggml-cuda/fattn.cu		diff \| blob \| history
ggml/src/ggml-cuda/mma.cuh		diff \| blob \| history
ggml/src/ggml-cuda/mmq.cu		diff \| blob \| history
ggml/src/ggml-cuda/mmq.cuh		diff \| blob \| history
ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu	[new file with mode: 0644]	blob
ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb32.cu	[new file with mode: 0644]	blob
ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb64.cu	[new file with mode: 0644]	blob
ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb8.cu	[new file with mode: 0644]	blob
ggml/src/ggml-cuda/template-instances/fattn-wmma-f16-instance-kqfloat-cpb16.cu	[deleted file]	blob \| history
ggml/src/ggml-cuda/template-instances/fattn-wmma-f16-instance-kqfloat-cpb32.cu	[deleted file]	blob \| history
ggml/src/ggml-cuda/template-instances/fattn-wmma-f16-instance-kqhalf-cpb16.cu	[deleted file]	blob \| history
ggml/src/ggml-cuda/template-instances/fattn-wmma-f16-instance-kqhalf-cpb32.cu	[deleted file]	blob \| history
ggml/src/ggml-cuda/template-instances/fattn-wmma-f16-instance-kqhalf-cpb8.cu	[deleted file]	blob \| history
ggml/src/ggml-cuda/template-instances/generate_cu_files.py		diff \| blob \| history
ggml/src/ggml-cuda/vendors/hip.h		diff \| blob \| history
ggml/src/ggml-hip/CMakeLists.txt		diff \| blob \| history
ggml/src/ggml-musa/CMakeLists.txt		diff \| blob \| history

Packaging of ggerganov/whisper.cpp

RSS Atom