]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 885c5bb)
server: allow accessing /metrics and /slots during llama_decode() (#27041)
authorXuan-Son Nguyen <redacted>
Fri, 14 Aug 2026 11:23:10 +0000 (13:23 +0200)
committerGitHub <redacted>
Fri, 14 Aug 2026 11:23:10 +0000 (13:23 +0200)
commit77918caf30e65f830ab0759c89779efdac28c77b
tree560218f5fd6a80f5a3f5601a6ffa636450dad212tree
parent885c5bbe8e04dc78db25beb911a2715312ad7b54commit | diff
server: allow accessing /metrics and /slots during llama_decode() (#27041)

* server_queue::worker

* call llama_decode inside yield_to_queue

* also handle process_mtmd_chunk

* clean up

* nits

* rm test
tools/server/server-context.cpp diff | blob | history
tools/server/server-queue.cpp diff | blob | history
tools/server/server-queue.h diff | blob | history
Packaging of ggml-org/llama.cpp