git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	Xuan Son Nguyen <redacted>
	Mon, 2 Sep 2024 15:11:51 +0000 (17:11 +0200)
committer	GitHub <redacted>
	Mon, 2 Sep 2024 15:11:51 +0000 (17:11 +0200)
commit	6e7d133a5f9409dd257fad90d7f320721b07a1b2
tree	db7a1abd77f4b053131ffee84bcbd89430a45b63	tree
parent	b60074f1c26d8354053a952844ef3f7ebefd8803	commit \| diff

server : refactor multitask handling (#9274)

* server : remove multitask from server_task

* refactor completions handler

* fix embeddings

* use res_ok everywhere

* small change for handle_slots_action

* use unordered_set everywhere

* (try) fix test

* no more "mutable" lambda

* Apply suggestions from code review

Co-authored-by: Georgi Gerganov <redacted>
* use deque

---------

Co-authored-by: Georgi Gerganov <redacted>

Packaging of ggml-org/llama.cpp

RSS Atom

examples/server/server.cpp		diff \| blob \| history
examples/server/tests/features/parallel.feature		diff \| blob \| history
examples/server/tests/features/steps/steps.py		diff \| blob \| history
examples/server/tests/features/wrong_usages.feature		diff \| blob \| history
examples/server/utils.hpp		diff \| blob \| history