]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
common : revert showing control tokens by default for server (#6860)
authorKyle Mistele <redacted>
Wed, 24 Apr 2024 10:15:29 +0000 (05:15 -0500)
committerGitHub <redacted>
Wed, 24 Apr 2024 10:15:29 +0000 (13:15 +0300)
commit37246b1031b1680c0dcaf20aef736d6b446203fa
treee058ba6529eb7436367f35d0d69e42684a8f431b
parent28103f4832e301a9c84d44ff0df9d75d46ab6c76
common : revert showing control tokens by default for server (#6860)

* fix: revert showing control tokens by default

* feat: revert changes to default behavior of llama_token_to_piece; provide overridden declaration to receive "bool special" param to toggle showing control tokens

* feat: use the overridden declaration of llama_token_to_piece from common/common.cpp to specify "false" so that control tokens are not shown in chat completion responses"

* common : simplify

---------

Co-authored-by: Georgi Gerganov <redacted>
common/common.cpp
common/common.h
examples/server/server.cpp