]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 37f230d)
rpc : proper handling of data pointers to CPU buffers (#21030)
authorRadoslav Gerganov <redacted>
Fri, 27 Mar 2026 08:59:35 +0000 (10:59 +0200)
committerGitHub <redacted>
Fri, 27 Mar 2026 08:59:35 +0000 (10:59 +0200)
commitba38f3becce7d1283585c73d796eb47d72bbbd30
treefa556d688d9bed1ba835dd16b202b8f168ea348dtree
parent37f230dd7cff6732580bec976ca9e378af230d20commit | diff
rpc : proper handling of data pointers to CPU buffers (#21030)

The compute graph may contain tensors pointing to CPU buffers. In these
cases the buffer address is serialized as 0 and sent over the wire.
However, the data pointer is serialized as-is and this prevents proper
validation on the server side. This patches fixes this by serializing
the data pointer as 0 for non-RPC buffers and doing proper validation on
the server side.

closes: #21006
ggml/src/ggml-rpc/ggml-rpc.cpp diff | blob | history
Packaging of ggml-org/llama.cpp