]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
Add some minimal optimizations for CDNA (#10498)
authoruvos <redacted>
Wed, 27 Nov 2024 16:10:08 +0000 (17:10 +0100)
committerGitHub <redacted>
Wed, 27 Nov 2024 16:10:08 +0000 (17:10 +0100)
commit3ad5451f3b75809e3033e4e577b9f60bcaf6676a
tree8c8b23f22ebe4228725ff713dcf04a62e6d17845
parent46c69e0e752ff16206347bb12f96ed69f4a01abf
Add some minimal optimizations for CDNA (#10498)

* Add some minimal optimizations for CDNA

* ggml_cuda: set launch bounds also for GCN as it helps there too
ggml/src/ggml-cuda/common.cuh
ggml/src/ggml-cuda/ggml-cuda.cu
ggml/src/ggml-cuda/mmq.cu
ggml/src/ggml-cuda/mmq.cuh
ggml/src/ggml-cuda/mmvq.cu
ggml/src/ggml-cuda/vendors/hip.h