git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	Pierrick Hymbert <redacted>
	Sun, 25 Feb 2024 12:49:43 +0000 (13:49 +0100)
committer	GitHub <redacted>
	Sun, 25 Feb 2024 12:49:43 +0000 (13:49 +0100)
commit	d52d7819b8ced70c642a88a59da8c78208dc58ec
tree	07841f1c5b7ab748bac463e62f3fb7ce0b7f96e9	tree
parent	12894088170f62e4cad4f8d6a3043c185b414bab	commit \| diff

server: concurrency fix + monitoring - add /metrics prometheus compatible endpoint (#5708)

* server: monitoring - add /metrics prometheus compatible endpoint

* server: concurrency issue, when 2 task are waiting for results, only one call thread is notified

* server: metrics - move to a dedicated struct

Packaging of ggml-org/llama.cpp

RSS Atom

examples/server/README.md		diff \| blob \| history
examples/server/server.cpp		diff \| blob \| history
examples/server/tests/features/environment.py		diff \| blob \| history
examples/server/tests/features/server.feature		diff \| blob \| history
examples/server/tests/features/steps/steps.py		diff \| blob \| history
examples/server/tests/requirements.txt		diff \| blob \| history
examples/server/utils.hpp		diff \| blob \| history