]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
Add some minimal optimizations for CDNA (llama/10498)
authoruvos <redacted>
Wed, 27 Nov 2024 16:10:08 +0000 (17:10 +0100)
committerGeorgi Gerganov <redacted>
Tue, 3 Dec 2024 19:05:37 +0000 (21:05 +0200)
commitae386e3e9801358e77910aac175d3af0c8c0d7d3
treebb36bb17fe84b9e5127c9956409767a531a8a44a
parent9e2697ff540bb6f73f22b1aa47639c627eafe860
Add some minimal optimizations for CDNA (llama/10498)

* Add some minimal optimizations for CDNA

* ggml_cuda: set launch bounds also for GCN as it helps there too
src/ggml-cuda/common.cuh
src/ggml-cuda/ggml-cuda.cu
src/ggml-cuda/mmq.cu
src/ggml-cuda/mmq.cuh
src/ggml-cuda/mmvq.cu
src/ggml-cuda/vendors/hip.h