]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server: prevent data race from HTTP threads (#18263)
authorXuan-Son Nguyen <redacted>
Mon, 22 Dec 2025 13:23:34 +0000 (14:23 +0100)
committerGitHub <redacted>
Mon, 22 Dec 2025 13:23:34 +0000 (14:23 +0100)
commit6ce863c8039b2dbfef2a22408f347842d438f03d
treeef0ce8f18898308dd86af0500a86a433ff9485b9
parent3997c78e339be05d8f64934f0765a6eead413e6e
server: prevent data race from HTTP threads (#18263)

* server: prevent data race from HTTP threads

* fix params

* fix default_generation_settings

* nits: make handle_completions_impl looks less strange

* stricter const

* fix GGML_ASSERT(idx < states.size())

* move index to be managed by server_response_reader

* http: make sure req & res lifecycle are tied together

* fix compile

* fix index handling buggy

* fix data race for lora endpoint

* nits: fix shadow variable

* nits: revert redundant changes

* nits: correct naming for json_webui_settings
tools/cli/cli.cpp
tools/server/server-common.cpp
tools/server/server-common.h
tools/server/server-context.cpp
tools/server/server-context.h
tools/server/server-http.cpp
tools/server/server-queue.cpp
tools/server/server-queue.h
tools/server/server-task.cpp
tools/server/server-task.h
tools/server/server.cpp