]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
Add some minimal optimizations for CDNA (llama/10498)
authoruvos <redacted>
Wed, 27 Nov 2024 16:10:08 +0000 (17:10 +0100)
committerGeorgi Gerganov <redacted>
Sun, 8 Dec 2024 18:14:35 +0000 (20:14 +0200)
commit230e985633c2466479c3d71df6c3ff89696f5d6d
tree757769d4cc07fb592cb2c35fd7b3ce92ea056b2b
parentae24083f237bbf1b362f0713615cd58b66360c1b
Add some minimal optimizations for CDNA (llama/10498)

* Add some minimal optimizations for CDNA

* ggml_cuda: set launch bounds also for GCN as it helps there too
ggml/src/ggml-cuda/common.cuh
ggml/src/ggml-cuda/ggml-cuda.cu
ggml/src/ggml-cuda/mmq.cu
ggml/src/ggml-cuda/mmq.cuh
ggml/src/ggml-cuda/mmvq.cu
ggml/src/ggml-cuda/vendors/hip.h