]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: c8a0090)
cuda : fix dmmv cols requirement to 2*GGML_CUDA_DMMV_X (#8800)
authorslaren <redacted>
Thu, 1 Aug 2024 13:26:22 +0000 (15:26 +0200)
committerGitHub <redacted>
Thu, 1 Aug 2024 13:26:22 +0000 (15:26 +0200)
commit7a11eb3a260915aee16101808f291a244e2facc7
tree16327aec59dd83daed5d9c214a426f84786d07e0tree
parentc8a0090922bad576623de4aae227717085249262commit | diff
cuda : fix dmmv cols requirement to 2*GGML_CUDA_DMMV_X (#8800)

* cuda : fix dmmv cols requirement to 2*GGML_CUDA_DMMV_X

* update asserts

* only use dmmv for supported types

* add test
ggml/src/ggml-cuda.cu diff | blob | history
ggml/src/ggml-cuda/dmmv.cu diff | blob | history
ggml/src/ggml-cuda/dmmv.cuh diff | blob | history
tests/test-backend-ops.cpp diff | blob | history
Packaging of ggml-org/llama.cpp