]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 2485d7a)
llama : only copy used KV cache in get / set state (#1272)
authorEvan Jones <redacted>
Wed, 3 May 2023 02:26:13 +0000 (22:26 -0400)
committerGitHub <redacted>
Wed, 3 May 2023 02:26:13 +0000 (22:26 -0400)
commite216aa04633892b972d013719e38b59fd4917341
tree53ffbc32f976fb799dd679204fa7e15f887f9e6btree
parent2485d7a4d39406cd0f468e35551b472cceb5bd61commit | diff
llama : only copy used KV cache in get / set state (#1272)

* llama : only copy used KV cache in get / set state

* switch to ggml for copying k, v

* avoid designated initializers
llama.cpp diff | blob | history
llama.h diff | blob | history
Packaging of ggml-org/llama.cpp