]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server : refactor middleware and /health endpoint (#9056)
authorXuan Son Nguyen <redacted>
Fri, 16 Aug 2024 15:19:05 +0000 (17:19 +0200)
committerGitHub <redacted>
Fri, 16 Aug 2024 15:19:05 +0000 (17:19 +0200)
commit8b3befc0e2ed8fb18b903735831496b8b0c80949
treef5db113b2d245c14b0fd97428c8de0bbe24cbf6e
parentd565bb2fd5a2a58b9924a7a34e77a87c78c52137
server : refactor middleware and /health endpoint (#9056)

* server : refactor middleware and /health endpoint

* move "fail_on_no_slot" to /slots

* Update examples/server/server.cpp

Co-authored-by: Georgi Gerganov <redacted>
* fix server tests

* fix CI

* update server docs

---------

Co-authored-by: Georgi Gerganov <redacted>
examples/server/README.md
examples/server/server.cpp
examples/server/tests/features/steps/steps.py