]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 8687c1f)
main : evaluate tokens in batches after swapping context (#1014)
authorAlex Klinkhamer <redacted>
Fri, 21 Apr 2023 18:18:09 +0000 (11:18 -0700)
committerGitHub <redacted>
Fri, 21 Apr 2023 18:18:09 +0000 (21:18 +0300)
commit9411288271ab548216902a029f42a0a38ebcedb7
treef480e35b257b61b0325be1e15ee9ff8be0f3c9a3tree
parent8687c1f2581d059cd5b6a9502f89bd343566062acommit | diff
main : evaluate tokens in batches after swapping context (#1014)

* examples : evaluate tokens in batches after swapping context

* Update examples/main/main.cpp

---------

Co-authored-by: Georgi Gerganov <redacted>
examples/main/main.cpp diff | blob | history
Packaging of ggml-org/llama.cpp