git.djapps.eu Git - pkg/ggml/sources/ggml/commit

]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit

overview / pkg / ggml / sources / ggml / commit

author	Johannes Gäßler <redacted>
	Fri, 9 May 2025 11:34:58 +0000 (13:34 +0200)
committer	Georgi Gerganov <redacted>
	Tue, 13 May 2025 10:02:19 +0000 (13:02 +0300)
commit	bdfb7fc0c02b2be2abf05aaec8adc0c0f249b0a3
tree	b06d292745c81ec8b39377cb644772951d739256	tree
parent	ac47d234ec637ba9ccebce8cb9243e28198f0992	commit \| diff

CUDA: FA support for Deepseek (Ampere or newer) (llama/13306)

* CUDA: FA support for Deepseek (Ampere or newer)

* do loop unrolling via C++ template

32 files changed:

src/ggml-cuda/CMakeLists.txt		diff \| blob \| history
src/ggml-cuda/common.cuh		diff \| blob \| history
src/ggml-cuda/cp-async.cuh		diff \| blob \| history
src/ggml-cuda/fattn-common.cuh		diff \| blob \| history
src/ggml-cuda/fattn-mma-f16.cuh		diff \| blob \| history
src/ggml-cuda/fattn-tile-f16.cu		diff \| blob \| history
src/ggml-cuda/fattn-tile-f32.cu		diff \| blob \| history
src/ggml-cuda/fattn-vec-f16.cuh		diff \| blob \| history
src/ggml-cuda/fattn-vec-f32.cuh		diff \| blob \| history
src/ggml-cuda/fattn-wmma-f16.cu		diff \| blob \| history
src/ggml-cuda/fattn.cu		diff \| blob \| history
src/ggml-cuda/ggml-cuda.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_1-ncols2_16.cu	[new file with mode: 0644]	blob
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_1-ncols2_8.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_16-ncols2_1.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_16-ncols2_2.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_16-ncols2_4.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_2-ncols2_16.cu	[new file with mode: 0644]	blob
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_2-ncols2_4.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_2-ncols2_8.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_32-ncols2_1.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_32-ncols2_2.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_16.cu	[new file with mode: 0644]	blob
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_2.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_4.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_8.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_64-ncols2_1.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_1.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_2.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_4.cu		diff \| blob \| history
src/ggml-cuda/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_8.cu		diff \| blob \| history
src/ggml-cuda/template-instances/generate_cu_files.py		diff \| blob \| history

Packaging of ggml-org/ggml

RSS Atom