]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server : (refactoring) do not rely on JSON internally (#10643)
authorXuan Son Nguyen <redacted>
Fri, 6 Dec 2024 10:14:32 +0000 (11:14 +0100)
committerGitHub <redacted>
Fri, 6 Dec 2024 10:14:32 +0000 (11:14 +0100)
commit6c5bc0625fae6909cb40def15bc4bb45db6f7f4d
tree7fbaf8fb0728c3e9046a2e9ba597390a12ddd547
parent7736837d62efed1dbebfe579472fca041eda12d6
server : (refactoring) do not rely on JSON internally (#10643)

* server : (refactoring) reduce usage of json internally

* move all response types to struct

* wip [no ci]

* many fixes

* add virtual function

* fix index

* minor style fix

* add std::move

* refactor handle_completions_generic

* add virtual functions

* remove server.hpp

* clarify server_sent_event RFC specs

* apply review comments

* fix model_alias and completion_probabilities

* small clean up

* remove virtual for to_json_oai_compat()

* naming oai_compat --> oaicompat

* fix unwanted recursive call

* update docs
common/common.h
examples/server/README.md
examples/server/server.cpp
examples/server/tests/README.md
examples/server/tests/tests.sh
examples/server/tests/unit/test_chat_completion.py
examples/server/tests/unit/test_completion.py
examples/server/utils.hpp