]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
kv-cache : fix shift and defrag logic (#14081)
authorGeorgi Gerganov <redacted>
Mon, 9 Jun 2025 20:04:35 +0000 (23:04 +0300)
committerGitHub <redacted>
Mon, 9 Jun 2025 20:04:35 +0000 (23:04 +0300)
commit40cbf571c9210031340f022d104317e89a1a6bb2
tree8b62c75776a3fc372f7bed7e7867af2da7339e2d
parent7f4fbe5183b23b6b2e25fd1ccc5d1fa8bb010cb7
kv-cache : fix shift and defrag logic (#14081)

* kv-cache : fix shift

ggml-ci

* cont : reset shift[i]

ggml-ci

* cont : fix defrag erasing cells that didn't move

ggml-ci
src/llama-kv-cache-unified.cpp
src/llama-kv-cells.h