]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
ggml-rpc: chunk send()/recv() to avoid EINVAL for very large tensors over RPC (macOS...
authorTak-RS <redacted>
Wed, 13 Aug 2025 05:54:30 +0000 (14:54 +0900)
committerGeorgi Gerganov <redacted>
Thu, 14 Aug 2025 11:17:28 +0000 (14:17 +0300)
commit0b631205ea365f540c7e46835ebfd5ae091af483
tree12f289ef2b1599e20815f51fb8842b3c9256a951
parent4938f43030fe305019415152bb10b4f25046c600
ggml-rpc: chunk send()/recv() to avoid EINVAL for very large tensors over RPC (macOS & others) (llama/15188)

* ggml-rpc: chunk send()/recv() to avoid EINVAL for very large tensors over RPC (macOS & others). Fixes #15055

* ggml-rpc: rename RPC_IO_CHUNK->MAX_CHUNK_SIZE, use std::min() for cap, switch to GGML_LOG_ERROR, handle 0-length send/recv

* rpc: drop n==0 special case in send_data(); retry in loop per review

* rpc: remove trailing whitespace in send_data()

---------

Co-authored-by: Shinnosuke Takagi <redacted>
src/ggml-rpc/ggml-rpc.cpp