]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server: move msg diffs tracking to HTTP thread (#17740)
authorXuan-Son Nguyen <redacted>
Thu, 4 Dec 2025 14:46:08 +0000 (15:46 +0100)
committerGitHub <redacted>
Thu, 4 Dec 2025 14:46:08 +0000 (15:46 +0100)
commitc4c10bfb86569ccb070d0dbe1a621a8f186baa16
treec49edeed54b73287d20eb6e67ffd57834a5d045e
parent817d743cc17cf644dab8408eb0f1e6eac89562c1
server: move msg diffs tracking to HTTP thread  (#17740)

* server: move msg diffs tracking to HTTP thread

* wip

* tool call tests ok

* minor : style

* cont : fix

* move states to server_response_reader

* add safe-guard

* fix

* fix 2

---------

Co-authored-by: Georgi Gerganov <redacted>
tools/server/server-context.cpp
tools/server/server-queue.cpp
tools/server/server-queue.h
tools/server/server-task.cpp
tools/server/server-task.h