]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
Support for models with non-512-aligned tensors over RPC. (llama/11047)
authormatt23654 <redacted>
Sat, 4 Jan 2025 16:10:30 +0000 (16:10 +0000)
committerGeorgi Gerganov <redacted>
Tue, 14 Jan 2025 08:38:01 +0000 (10:38 +0200)
commitdcbb375779b586261a745622e88e9c6d011236e8
tree2a485c6201b0bb3dd13d40bc41ee21f2ee29d3fe
parent4334c71aed4df7dc146e2b6153faa77f98f43db1
Support for models with non-512-aligned tensors over RPC. (llama/11047)

* Added init tensor calling code

* Added get_alloc_size forwarding

* Cleaned up and improved type/error handling.

* fix: remove trailing whitespaces.

* Cleanup and use GGML error logging functions.

* Handle potentially dangerous edge cases.

* Apply suggestions from code review

Co-authored-by: Diego Devesa <redacted>
---------

Co-authored-by: Diego Devesa <redacted>
ggml/src/ggml-rpc/ggml-rpc.cpp