]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: b345178)
`tool-call`: allow `--chat-template chatml` w/ `--jinja`, default to chatml upon...
authorOlivier Chafik <redacted>
Mon, 3 Feb 2025 23:49:27 +0000 (23:49 +0000)
committerGitHub <redacted>
Mon, 3 Feb 2025 23:49:27 +0000 (23:49 +0000)
commitcde383323959544abe10a4d79e1d3e1ee479933c
treed3dfee36fb174c28def327f3e21c67f3a4f0e7e6tree
parentb3451785aca16fbf4214eeba7e4612676cdf8ccbcommit | diff
`tool-call`: allow `--chat-template chatml` w/ `--jinja`, default to chatml upon parsing issue, avoid double bos (#11616)

* tool-call: allow `--jinja --chat-template chatml`

* fix double bos issue (drop bos/eos tokens from jinja template)

* add missing try catch around jinja parsing to default to chatml

* Simplify default chatml logic
common/common.cpp diff | blob | history
examples/server/tests/unit/test_chat_completion.py diff | blob | history
examples/server/tests/unit/test_tool_call.py diff | blob | history
Packaging of ggml-org/llama.cpp