]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server: split HTTP into its own interface (#17216)
authorXuan-Son Nguyen <redacted>
Mon, 17 Nov 2025 21:05:44 +0000 (22:05 +0100)
committerGitHub <redacted>
Mon, 17 Nov 2025 21:05:44 +0000 (22:05 +0100)
commit0de8878c961c36c88cca5a0c188ae7a6e5a4b778
treefb2d1f345acfd9c2dc26ba6b5466dacce956db7e
parent38e2c1b4128fe3ac75dc563dd12d31b9011f4a26
server: split HTTP into its own interface (#17216)

* server: split HTTP into its own interface

* move server-http and httplib to its own file

* add the remaining endpoints

* fix exception/error handling

* renaming

* missing header

* fix missing windows header

* fix error responses from http layer

* fix slot save/restore handler

* fix case where only one stream chunk is returned

* add NOMINMAX

* do not call sink.write on empty data

* use safe_json_to_str for SSE

* clean up

* add some comments

* improve usage of next()

* bring back the "server is listening on" message

* more generic handler

* add req.headers

* move the chat template print to init()

* add req.path

* cont : minor

---------

Co-authored-by: Georgi Gerganov <redacted>
tools/server/CMakeLists.txt
tools/server/server-http.cpp [new file with mode: 0644]
tools/server/server-http.h [new file with mode: 0644]
tools/server/server.cpp
tools/server/utils.hpp