]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 46be942)
[GGML][RPC] Support for models with non-512-aligned tensors over RPC. (#11047)
authormatt23654 <redacted>
Sat, 4 Jan 2025 16:10:30 +0000 (16:10 +0000)
committerGitHub <redacted>
Sat, 4 Jan 2025 16:10:30 +0000 (17:10 +0100)
commitf922a9c542ee117550a168395c63ea79261f5c99
tree0421cb3667e5a245243117b1f3b25f1abf68ac7ctree
parent46be942214e295cd34660bbbd6b846155d1c36a0commit | diff
[GGML][RPC] Support for models with non-512-aligned tensors over RPC. (#11047)

* Added init tensor calling code

* Added get_alloc_size forwarding

* Cleaned up and improved type/error handling.

* fix: remove trailing whitespaces.

* Cleanup and use GGML error logging functions.

* Handle potentially dangerous edge cases.

* Apply suggestions from code review

Co-authored-by: Diego Devesa <redacted>
---------

Co-authored-by: Diego Devesa <redacted>
ggml/src/ggml-rpc/ggml-rpc.cpp diff | blob | history
Packaging of ggml-org/llama.cpp