]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
overview / pkg / ggml / sources / whisper.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 49e0a42)
rpc : add support for multiple devices (llama/16276)
authorRadoslav Gerganov <redacted>
Sat, 4 Oct 2025 09:49:16 +0000 (12:49 +0300)
committerGeorgi Gerganov <redacted>
Sun, 12 Oct 2025 08:16:23 +0000 (11:16 +0300)
commitaf51bbab88bb28429abba6d660c96aadec2e2da9
tree1532d3225b080ee43b5749fb80a4f522249bb420tree
parent49e0a426f356113c0878f892f2603725eeb78463commit | diff
rpc : add support for multiple devices (llama/16276)

* rpc : add support for multiple devices

Allow rpc-server to expose multiple devices from a single endpoint.
Change RPC protocol to include device identifier where needed.

closes: #15210

* fixes

* use ggml_backend_reg_t

* address review comments

* fix llama-bench backend report

* address review comments, change device naming

* fix cmd order
ggml/include/ggml-backend.h diff | blob | history
ggml/include/ggml-rpc.h diff | blob | history
ggml/src/ggml-backend-impl.h diff | blob | history
ggml/src/ggml-rpc/ggml-rpc.cpp diff | blob | history
Packaging of ggerganov/whisper.cpp