git.djapps.eu Git - pkg/ggml/sources/ggml/commit

]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit

overview / pkg / ggml / sources / ggml / commit

author	Johannes Gäßler <redacted>
	Sun, 2 Feb 2025 18:31:09 +0000 (19:31 +0100)
committer	Georgi Gerganov <redacted>
	Mon, 3 Feb 2025 12:44:49 +0000 (14:44 +0200)
commit	0f36dae8a7cb3e1b97225cd71d32142a3fbe1ce5
tree	d52465fa5c7a95fa3adf0cec139026e5ffc5c172	tree
parent	0362e2ba39cd8ef180334e33e4c430599d399fb4	commit \| diff

CUDA: use mma PTX instructions for FlashAttention (llama/11583)

* CUDA: use mma PTX instructions for FlashAttention

* __shfl_sync workaround for movmatrix

* add __shfl_sync to HIP

Co-authored-by: Diego Devesa <redacted>

28 files changed:

include/ggml.h		diff \| blob \| history
src/ggml-cuda/CMakeLists.txt		diff \| blob \| history
src/ggml-cuda/common.cuh		diff \| blob \| history
src/ggml-cuda/fattn-common.cuh		diff \| blob \| history
src/ggml-cuda/fattn-mma-f16.cuh	[new file with mode: 0644]	blob
src/ggml-cuda/fattn-tile-f16.cu		diff \| blob \| history
src/ggml-cuda/fattn-tile-f32.cu		diff \| blob \| history
src/ggml-cuda/fattn-vec-f16.cuh		diff \| blob \| history
src/ggml-cuda/fattn-vec-f32.cuh		diff \| blob \| history
src/ggml-cuda/fattn-wmma-f16.cu	[new file with mode: 0644]	blob
src/ggml-cuda/fattn-wmma-f16.cuh		diff \| blob \| history
src/ggml-cuda/fattn.cu		diff \| blob \| history
src/ggml-cuda/mma.cuh		diff \| blob \| history
src/ggml-cuda/mmq.cu		diff \| blob \| history
src/ggml-cuda/mmq.cuh		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu	[new file with mode: 0644]	blob
src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb32.cu	[new file with mode: 0644]	blob
src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb64.cu	[new file with mode: 0644]	blob
src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb8.cu	[new file with mode: 0644]	blob
src/ggml-cuda/template-instances/fattn-wmma-f16-instance-kqfloat-cpb16.cu	[deleted file]	blob \| history
src/ggml-cuda/template-instances/fattn-wmma-f16-instance-kqfloat-cpb32.cu	[deleted file]	blob \| history
src/ggml-cuda/template-instances/fattn-wmma-f16-instance-kqhalf-cpb16.cu	[deleted file]	blob \| history
src/ggml-cuda/template-instances/fattn-wmma-f16-instance-kqhalf-cpb32.cu	[deleted file]	blob \| history
src/ggml-cuda/template-instances/fattn-wmma-f16-instance-kqhalf-cpb8.cu	[deleted file]	blob \| history
src/ggml-cuda/template-instances/generate_cu_files.py		diff \| blob \| history
src/ggml-cuda/vendors/hip.h		diff \| blob \| history
src/ggml-hip/CMakeLists.txt		diff \| blob \| history
src/ggml-musa/CMakeLists.txt		diff \| blob \| history

Packaging of ggml-org/ggml

RSS Atom