]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server : update readme to document the new `/health` endpoint (#4866)
authorBehnam M <redacted>
Thu, 11 Jan 2024 07:12:05 +0000 (02:12 -0500)
committerGitHub <redacted>
Thu, 11 Jan 2024 07:12:05 +0000 (09:12 +0200)
commit7a9f75c38b5e62fe27b8a5a3ed823b4a3714024b
treef4a60e38d886f8d72b051541e6d27823d4d35a11
parent5c1980d8d4c4e0c0af77359f81cc44d90b3f250b
server : update readme to document the new `/health` endpoint (#4866)

* added /health endpoint to the server

* added comments on the additional /health endpoint

* Better handling of server state

When the model is being loaded, the server state is `LOADING_MODEL`. If model-loading fails, the server state becomes `ERROR`, otherwise it becomes `READY`. The `/health` endpoint provides more granular messages now according to the server_state value.

* initialized server_state

* fixed a typo

* starting http server before initializing the model

* Update server.cpp

* Update server.cpp

* fixes

* fixes

* fixes

* made ServerState atomic and turned two-line spaces into one-line

* updated `server` readme to document the `/health` endpoint too
examples/server/README.md