]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server : OAI API compatibility (#4198)
authorGeorgi Gerganov <redacted>
Sat, 25 Nov 2023 09:29:06 +0000 (11:29 +0200)
committerGitHub <redacted>
Sat, 25 Nov 2023 09:29:06 +0000 (11:29 +0200)
commitaf19d3573481d409b3c4e55494810eb1f65a9aae
tree7ea1f05240ac9724ed945608c3c4ae2cfeff7d38
parente9c13ff78114af6fc6a4f27cc8dcdda0f3d389fb
server : OAI API compatibility (#4198)

* Add openai-compatible POST /v1/chat/completions API endpoint to server example

* fix code style

* Update server README.md

* Improve server README.md

* Fix server.cpp code style according to review

* server : some style changes

* server : indentation

* server : enable special tokens during tokenization by default

* server : minor code style

* server : change random string generator

* straightforward /v1/models endpoint

---------

Co-authored-by: kir-gadjello <redacted>
Co-authored-by: Tobi Lütke <redacted>
examples/server/README.md
examples/server/server.cpp