]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 517b717)
server : remove n_past (#16818)
authorGeorgi Gerganov <redacted>
Thu, 30 Oct 2025 16:42:57 +0000 (18:42 +0200)
committerGitHub <redacted>
Thu, 30 Oct 2025 16:42:57 +0000 (18:42 +0200)
commitb52edd25586fabb70f0c21b274473b307cf14499
tree59c5cbc8d058ea97d99993a86647145ed07c212dtree
parent517b7170e1a4d733583c4b07c5b7a49acc05911ccommit | diff
server : remove n_past (#16818)

* server : remove n_past

* server : replace slot.n_prompt_tokens() with slot.task->n_tokens()

* server : fixes + clean-up

* cont : fix context shift

* server : add server_tokens::pos_next()

Co-authored-by: Xuan-Son Nguyen <redacted>
* server : fix pos_next() usage

Co-authored-by: Xuan-Son Nguyen <redacted>
---------

Co-authored-by: Xuan-Son Nguyen <redacted>
tools/server/README.md diff | blob | history
tools/server/server.cpp diff | blob | history
tools/server/utils.hpp diff | blob | history
Packaging of ggml-org/llama.cpp