]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
CUDA: fix MMQ for non-contiguous src0, add tests (#10021)
authorJohannes Gäßler <redacted>
Thu, 24 Oct 2024 09:09:36 +0000 (11:09 +0200)
committerGitHub <redacted>
Thu, 24 Oct 2024 09:09:36 +0000 (11:09 +0200)
commitc39665f589091903396a442a6ee56613303e0350
tree78eb970fb9d939dd75af1ac3b095290b50999ee8
parent0a1c750c80147687df267114c81956757cc14382
CUDA: fix MMQ for non-contiguous src0, add tests (#10021)

* CUDA: fix MMQ for non-contiguous src0, add tests

* revise test code
ggml/src/ggml-cuda.cu
ggml/src/ggml-cuda/mmq.cu
ggml/src/ggml.c
tests/test-backend-ops.cpp