]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 1f5cd83)
py : fix oai proxy (#3972)
authorrhjdvsgsgks <redacted>
Thu, 30 Nov 2023 20:50:40 +0000 (20:50 +0000)
committerGitHub <redacted>
Thu, 30 Nov 2023 20:50:40 +0000 (22:50 +0200)
commite2bd725f4b39bc5c6234858d158e01248f5ab5bd
treefa8fe8fe3d867f3d36d719d8a4dbeea5183f7412tree
parent1f5cd83275fabb43f2ae92c30033b384a3eb37b4commit | diff
py : fix oai proxy (#3972)

* fix oai proxy

fix generation not stoped while bot stop talking in chat mode

fix possible `slot_id` not exist

response for cors (and pre flight)

* oai proxy: workaround for some client (such as Chatbox)

* use stop as separator to replace hardcoded `\n`
examples/server/api_like_OAI.py diff | blob | history
Packaging of ggml-org/llama.cpp