]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
cuda : fix dmmv cols requirement to 2*GGML_CUDA_DMMV_X (llama/8800)
authorslaren <redacted>
Thu, 1 Aug 2024 13:26:22 +0000 (15:26 +0200)
committerGeorgi Gerganov <redacted>
Thu, 8 Aug 2024 10:45:29 +0000 (13:45 +0300)
commit58e50d280a94177b403ca7d1b32ee496431c8c24
tree195ef166a67c65071f210bf5d8f991de447787af
parent597f40abf2da632690d5ebee3bce6f28a41ebbf4
cuda : fix dmmv cols requirement to 2*GGML_CUDA_DMMV_X (llama/8800)

* cuda : fix dmmv cols requirement to 2*GGML_CUDA_DMMV_X

* update asserts

* only use dmmv for supported types

* add test
src/ggml-cuda.cu
src/ggml-cuda/dmmv.cu
src/ggml-cuda/dmmv.cuh
tests/test-backend-ops.cpp