]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 7bfd45d)
rpc : add support for multiple devices (llama/16276)
authorRadoslav Gerganov <redacted>
Sat, 4 Oct 2025 09:49:16 +0000 (12:49 +0300)
committerGeorgi Gerganov <redacted>
Sun, 12 Oct 2025 04:57:25 +0000 (07:57 +0300)
commitb0813b924797235bd573dbaf36fdfe367c880611
tree5951e910cb86a713b26e604981872ae7c735925etree
parent7bfd45d1d368c4a7e7bfe4ba82452cacdbc69386commit | diff
rpc : add support for multiple devices (llama/16276)

* rpc : add support for multiple devices

Allow rpc-server to expose multiple devices from a single endpoint.
Change RPC protocol to include device identifier where needed.

closes: #15210

* fixes

* use ggml_backend_reg_t

* address review comments

* fix llama-bench backend report

* address review comments, change device naming

* fix cmd order
include/ggml-backend.h diff | blob | history
include/ggml-rpc.h diff | blob | history
src/ggml-backend-impl.h diff | blob | history
src/ggml-rpc/ggml-rpc.cpp diff | blob | history
Packaging of ggml-org/ggml