]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 96d7f56)
server : defer tasks when "slot unavailable" (#5018)
authorXuan Son Nguyen <redacted>
Thu, 18 Jan 2024 20:33:05 +0000 (21:33 +0100)
committerGitHub <redacted>
Thu, 18 Jan 2024 20:33:05 +0000 (22:33 +0200)
commit821f0a271e7c9ee737945245dd7abfa22cc9b5b0
tree57736f3c7ebd7e24d4d9dcffdb6ee76b2c108efatree
parent96d7f56d2918ffde1995dbb32392571deb76d7fccommit | diff
server : defer tasks when "slot unavailable" (#5018)

* server: defer task when no slot is available

* remove unnecessary log

---------

Co-authored-by: Xuan Son Nguyen <redacted>
examples/server/server.cpp diff | blob | history
Packaging of ggml-org/llama.cpp