]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 4371bc2)
Add an option to build without CUDA VMM (llama/7067)
authorWilliam Tambellini <redacted>
Mon, 6 May 2024 18:12:14 +0000 (11:12 -0700)
committerGeorgi Gerganov <redacted>
Sat, 11 May 2024 18:30:08 +0000 (21:30 +0300)
commit7ce8bcc3a513514f30230010224497c00b8cc71d
tree938c3d2c83625a7a649d26ae600c9e97de8b44d6tree
parent4371bc22aa5a209df1883967325451d20f6a7b80commit | diff
Add an option to build without CUDA VMM (llama/7067)

Add an option to build ggml cuda without CUDA VMM
resolves
https://github.com/ggerganov/llama.cpp/issues/6889
https://forums.developer.nvidia.com/t/potential-nvshmem-allocated-memory-performance-issue/275416/4
src/ggml-cuda.cu diff | blob | history
Packaging of ggml-org/ggml