]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
kv-cells : fix tracking of seq_pos (#14339)
authorGeorgi Gerganov <redacted>
Mon, 23 Jun 2025 09:27:35 +0000 (12:27 +0300)
committerGitHub <redacted>
Mon, 23 Jun 2025 09:27:35 +0000 (12:27 +0300)
commit7b50d589a863c7631135c1226f6eab65cb406212
treeebd80fd9238d6688f8263b79abedcab15dabf837
parent3a9457df962b5883f2773f1c295e8c19df60d89f
kv-cells : fix tracking of seq_pos (#14339)

* kv-cells : fix tracking of seq_pos during cache reuse

ggml-ci

* cont : improve error message

ggml-ci

* cont : add more comments
include/llama.h
src/llama-batch.cpp
src/llama-context.cpp
src/llama-kv-cells.h
tools/server/server.cpp