]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
kv-cache : refactor the update/defrag mechanism (#13988)
authorGeorgi Gerganov <redacted>
Wed, 4 Jun 2025 15:58:20 +0000 (18:58 +0300)
committerGitHub <redacted>
Wed, 4 Jun 2025 15:58:20 +0000 (18:58 +0300)
commit3e63a58ef7addec35408e2eb67850d7cdc935dc3
tree612e12e839cafa3db5bea2a6fc00a69c6f7c2082
parent2589ad3704559f4dd860f5f303b19349c688a28a
kv-cache : refactor the update/defrag mechanism (#13988)

* kv-cache : refactor update mechanism

ggml-ci

* memory : improve status handling

* defrag : reset head + add comments

ggml-ci

* cont : minor fixes

ggml-ci
src/llama-context.cpp
src/llama-context.h
src/llama-kv-cache-recurrent.cpp
src/llama-kv-cache-recurrent.h
src/llama-kv-cache-unified-iswa.cpp
src/llama-kv-cache-unified-iswa.h
src/llama-kv-cache-unified.cpp
src/llama-kv-cache-unified.h
src/llama-kv-cache.h
src/llama-memory.cpp
src/llama-memory.h