git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	Radoslav Gerganov <redacted>
	Sat, 4 Oct 2025 09:49:16 +0000 (12:49 +0300)
committer	GitHub <redacted>
	Sat, 4 Oct 2025 09:49:16 +0000 (12:49 +0300)
commit	898acba6816ad23b6a9491347d30e7570bffadfd
tree	07e60dfc2aeb2c41dea3995061942cf8399ae9ea	tree
parent	e29acf74fea996014380d59d31aa504ae8964258	commit \| diff

rpc : add support for multiple devices (#16276)

* rpc : add support for multiple devices

Allow rpc-server to expose multiple devices from a single endpoint.
Change RPC protocol to include device identifier where needed.

closes: #15210

* fixes

* use ggml_backend_reg_t

* address review comments

* fix llama-bench backend report

* address review comments, change device naming

* fix cmd order

Packaging of ggml-org/llama.cpp

RSS Atom

common/arg.cpp		diff \| blob \| history
ggml/include/ggml-backend.h		diff \| blob \| history
ggml/include/ggml-rpc.h		diff \| blob \| history
ggml/src/ggml-backend-impl.h		diff \| blob \| history
ggml/src/ggml-rpc/ggml-rpc.cpp		diff \| blob \| history
tools/llama-bench/llama-bench.cpp		diff \| blob \| history
tools/rpc/rpc-server.cpp		diff \| blob \| history