]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: efb37a3)
examples : use scratch buffers to reduce memory usage (#176)
authorGeorgi Gerganov <redacted>
Sat, 20 May 2023 17:56:35 +0000 (20:56 +0300)
committerGitHub <redacted>
Sat, 20 May 2023 17:56:35 +0000 (20:56 +0300)
commitd6957552095ddb1a321a213be189cb70c94c5857
tree675489ed4d2161e8e14ff6035d7ac297cf516dfdtree
parentefb37a3f4cbe01d9faed184c6daee5751dfe6e13commit | diff
examples : use scratch buffers to reduce memory usage (#176)

* starcoder : example for using scratch buffers to reduce memory usage

* starcoder : bump scratch buffers to 256 MB

* examples : add scratch buffers to MPT and GPT-NeoX
examples/gpt-neox/main.cpp diff | blob | history
examples/mpt/main.cpp diff | blob | history
examples/starcoder/main.cpp diff | blob | history
src/ggml.c diff | blob | history
Packaging of ggml-org/ggml