]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server: fix streaming crashes (#13786)
authorOlivier Chafik <redacted>
Mon, 26 May 2025 15:03:57 +0000 (08:03 -0700)
committerGitHub <redacted>
Mon, 26 May 2025 15:03:57 +0000 (16:03 +0100)
commit03f582ae8fccecff225c30a2802461b44761e822
tree5801be014632ac29f596c0580ade394ca3f11f19
parent88c125f2acce0e25e5fc8481ab0681415fc64a10
server: fix streaming crashes (#13786)

* add preludes to content on partial regex match

* allow all parsers to parse non-tool-call content.

* tweak order of <|python_tag|> vs <function= parsing for functionary v3.1 format. still not ideal but hopefully less prone to crash
common/chat-parser.cpp
common/chat-parser.h
common/chat.cpp
common/chat.h
tests/test-chat.cpp
tools/server/server.cpp
tools/server/utils.hpp