]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commitdiff
server : add `LOG_INFO` when model is successfully loaded (#4881)
authorBehnam M <redacted>
Thu, 11 Jan 2024 17:41:39 +0000 (12:41 -0500)
committerGitHub <redacted>
Thu, 11 Jan 2024 17:41:39 +0000 (19:41 +0200)
* added /health endpoint to the server

* added comments on the additional /health endpoint

* Better handling of server state

When the model is being loaded, the server state is `LOADING_MODEL`. If model-loading fails, the server state becomes `ERROR`, otherwise it becomes `READY`. The `/health` endpoint provides more granular messages now according to the server_state value.

* initialized server_state

* fixed a typo

* starting http server before initializing the model

* Update server.cpp

* Update server.cpp

* fixes

* fixes

* fixes

* made ServerState atomic and turned two-line spaces into one-line

* updated `server` readme to document the `/health` endpoint too

* used LOG_INFO after successful model loading

examples/server/server.cpp

index 860e4e9ae3d814a72b824a7facc546ebfd773eff..51a4b689f78b1e739b7b19340095b8dc8ebfc176 100644 (file)
@@ -2906,6 +2906,7 @@ int main(int argc, char **argv)
     } else {
         llama.initialize();
         state.store(SERVER_STATE_READY);
+        LOG_INFO("model loaded", {});
     }
 
     // Middleware for API key validation