]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: ebcee20)
metal : fix memory leak (#2762)
authorGeorgi Gerganov <redacted>
Mon, 28 Aug 2023 07:59:08 +0000 (10:59 +0300)
committerGitHub <redacted>
Mon, 28 Aug 2023 07:59:08 +0000 (10:59 +0300)
commitf55538c3ccba9b926846ef862fa830cea08c433e
tree667e9cd791f2d4e44465067e4a5a2a909ef7957btree
parentebcee207b6058b7f695bb5c203ad87b1066a9790commit | diff
metal : fix memory leak (#2762)

* metal : fix memory leak

* metal : fix encoders memory leak

* metal : clean up more memory resources

* metal : fix more leaks

* metal : reuse dispatch queue + autoreleasepool

* metal : reuse array for command buffers and encoders

* ggml : assert for odd number of blocks on ARM

15M tinyllama is an example
ggml-metal.h diff | blob | history
ggml-metal.m diff | blob | history
ggml.c diff | blob | history
Packaging of ggml-org/llama.cpp