]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
kv-cache : support layer reuse (#15504)
authorGeorgi Gerganov <redacted>
Sun, 24 Aug 2025 10:07:07 +0000 (13:07 +0300)
committerGitHub <redacted>
Sun, 24 Aug 2025 10:07:07 +0000 (13:07 +0300)
commitb730706a49e576fb882dc34d9966345778b3ab0b
tree9f9fbaf8c7ff4a82ac54065c0d4a8d2e6c196fba
parentc9a24fb93208fbbd3da6d903eb75431bfa97e59e
kv-cache : support layer reuse (#15504)

* kv-cache : support layer reuse

ggml-ci

* cont : update comments [no ci]
12 files changed:
src/llama-hparams.cpp
src/llama-hparams.h
src/llama-kv-cache-iswa.cpp
src/llama-kv-cache-iswa.h
src/llama-kv-cache.cpp
src/llama-kv-cache.h
src/llama-memory-hybrid.cpp
src/llama-memory-hybrid.h
src/llama-memory-recurrent.cpp
src/llama-memory-recurrent.h
src/llama-memory.h
src/llama-model.cpp