]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
CUDA: manage NCCL communicators in context (llama/21891)
authorJohannes Gäßler <redacted>
Wed, 15 Apr 2026 13:58:40 +0000 (15:58 +0200)
committerGeorgi Gerganov <redacted>
Thu, 30 Apr 2026 08:29:09 +0000 (11:29 +0300)
commit7e57b20d533b2854738e005db9c4c8aa510d67bc
treeb1d0976f1eaf2cee298bdcc55e475a871e084e84
parent182db04cb2e6ce68b5bfa17571222b179f3840ae
CUDA: manage NCCL communicators in context (llama/21891)

* CUDA: manage NCCL communicators in context

* add check that all backends are CUDA

* remove unused vector, limit init to > 1 GPUs

* fix warnings

* fix cuda device, cache allreduce
ggml/include/ggml-backend.h
ggml/src/ggml-backend-meta.cpp
ggml/src/ggml-cuda/common.cuh
ggml/src/ggml-cuda/ggml-cuda.cu