]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
cuda : fix dmmv cols requirement to 2*GGML_CUDA_DMMV_X (llama/8800)
authorslaren <redacted>
Thu, 1 Aug 2024 13:26:22 +0000 (15:26 +0200)
committerGeorgi Gerganov <redacted>
Thu, 8 Aug 2024 19:48:46 +0000 (22:48 +0300)
commit5218ea21b893f9ebe5c27ffc50a71204f50a6bd1
tree2a33972891016364e7a88df95fe7f13e72b00424
parente60be821ce4a06c125494819844c77f8e32121b7
cuda : fix dmmv cols requirement to 2*GGML_CUDA_DMMV_X (llama/8800)

* cuda : fix dmmv cols requirement to 2*GGML_CUDA_DMMV_X

* update asserts

* only use dmmv for supported types

* add test
ggml/src/ggml-cuda.cu
ggml/src/ggml-cuda/dmmv.cu
ggml/src/ggml-cuda/dmmv.cuh