]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server: (router) add stop-timeout option (#18350)
authorXuan-Son Nguyen <redacted>
Wed, 24 Dec 2025 22:47:49 +0000 (23:47 +0100)
committerGitHub <redacted>
Wed, 24 Dec 2025 22:47:49 +0000 (23:47 +0100)
commitf5acfb2ffa1a0bc9d01a0a40f4d7c17421d7d570
treee55c780e8f2d46a4792f0d038eaffa49828ebea7
parent4cbafad4f09c82f1b32c76b714302f3937be1df7
server: (router) add stop-timeout option (#18350)

* server: (router) add stop-timeout option

* also allow stop while loading

* add docs

* unload_lru: also wait for unload to complete
common/arg.cpp
common/arg.h
tools/server/README.md
tools/server/server-models.cpp
tools/server/server-models.h