]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
ggml : backport ggml-alloc from llama.cpp (#433)
authorSam Spilsbury <redacted>
Wed, 16 Aug 2023 19:44:18 +0000 (22:44 +0300)
committerGitHub <redacted>
Wed, 16 Aug 2023 19:44:18 +0000 (22:44 +0300)
commit854e45302b127ca1b01e3e636a81da62219c5667
tree2acff1fb5a0331ce54643d100ca4c1c51a824c0c
parent95b559dbae6a25b2a7e26ab5989c1538387225e9
ggml : backport ggml-alloc from llama.cpp (#433)

* ggml: add graph tensor allocator (#2411)

Backport a113689571420fb4d6540f1a324d12965781356a from llama.cpp

* ggml-alloc: Don't try to re-use buffers of external tensors

They might be weights that came from another context, so we
have no control over them (and they might be re-used elsewhere
so writing to them would be a bad idea).

* ggml-alloc: Fix some compile errors when GGML_ALLOCATOR_DEBUG is on

---------

Co-authored-by: slaren <redacted>
include/ggml/ggml-alloc.h [new file with mode: 0644]
src/CMakeLists.txt
src/ggml-alloc.c [new file with mode: 0644]