]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server : fix context shift (#5195)
authorGeorgi Gerganov <redacted>
Tue, 30 Jan 2024 18:17:30 +0000 (20:17 +0200)
committerGitHub <redacted>
Tue, 30 Jan 2024 18:17:30 +0000 (20:17 +0200)
commite6f291d15844398f8326940fe5ad7f2e02b5aa56
tree17ba1ea7cdaed162c636752b144247dda0445cba
parent4003be0e5feef320f3707786f22722b73cff9356
server : fix context shift (#5195)

* server : fix context shift + simplify self-extend

* server : take system_tokens into account

* server : more n_past fixes

* server : rever n_past_se changes
examples/server/chat.sh
examples/server/server.cpp