]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
CUDA: fix MMQ for non-contiguous src0, add tests (llama/10021)
authorJohannes Gäßler <redacted>
Thu, 24 Oct 2024 09:09:36 +0000 (11:09 +0200)
committerGeorgi Gerganov <redacted>
Fri, 1 Nov 2024 08:19:05 +0000 (10:19 +0200)
commitab0385f43b513fa7824a159d43fef682edcc288f
tree36ad78360cf39dc1dafc8b496954012df373bd7d
parent10eb603a3c07cdf4db8b5ba0c9d0cdcc20a4f93e
CUDA: fix MMQ for non-contiguous src0, add tests (llama/10021)

* CUDA: fix MMQ for non-contiguous src0, add tests

* revise test code
ggml/src/ggml-cuda.cu
ggml/src/ggml-cuda/mmq.cu
ggml/src/ggml.c