]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server : maintain chat completion id for streaming responses (#5988)
authorMinsoo Cheong <redacted>
Mon, 11 Mar 2024 08:09:32 +0000 (17:09 +0900)
committerGitHub <redacted>
Mon, 11 Mar 2024 08:09:32 +0000 (10:09 +0200)
commit332bdfd7980718abf664bfa5460f2288a3314984
tree4f6cc623350ef0b1fad735fc2b843a11bc88e381
parentecab1c75de68de7c41c254e2ae170d3b07bee6d4
server : maintain chat completion id for streaming responses (#5988)

* server: maintain chat completion id for streaming responses

* Update examples/server/utils.hpp

* Update examples/server/utils.hpp

---------

Co-authored-by: Georgi Gerganov <redacted>
examples/server/server.cpp
examples/server/utils.hpp