]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 5baac8c)
Support for models with non-512-aligned tensors over RPC. (llama/11047)
authormatt23654 <redacted>
Sat, 4 Jan 2025 16:10:30 +0000 (16:10 +0000)
committerGeorgi Gerganov <redacted>
Tue, 14 Jan 2025 07:36:36 +0000 (09:36 +0200)
commitd5cf976eb035def4de4d85dcb25d663b40066b62
treec644a4e9d87482bf69e78c48af435546a61c3d23tree
parent5baac8cdb1fa0aadeb79e74dcba19a0f3af0268acommit | diff
Support for models with non-512-aligned tensors over RPC. (llama/11047)

* Added init tensor calling code

* Added get_alloc_size forwarding

* Cleaned up and improved type/error handling.

* fix: remove trailing whitespaces.

* Cleanup and use GGML error logging functions.

* Handle potentially dangerous edge cases.

* Apply suggestions from code review

Co-authored-by: Diego Devesa <redacted>
---------

Co-authored-by: Diego Devesa <redacted>
src/ggml-rpc/ggml-rpc.cpp diff | blob | history
Packaging of ggml-org/ggml