]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
common/parser: add proper reasoning tag prefill reading (#20424)
authorPiotr Wilkin (ilintar) <redacted>
Thu, 19 Mar 2026 15:58:21 +0000 (16:58 +0100)
committerGitHub <redacted>
Thu, 19 Mar 2026 15:58:21 +0000 (16:58 +0100)
commit5e54d51b199ad2d70cf6eba4bff756bbf63366a6
tree460cb813e21742c6eb4c4ced83029bc737eae6d6
parentc1258830b28dddc65ac3aa3452214553fdece30c
common/parser: add proper reasoning tag prefill reading (#20424)

* Implement proper prefill extraction

* Refactor cli parameters, update docs, move reasoning budget sampler part to common/reasoning-budget.cpp

* Update tools/server/server-task.cpp

* refactor: move grammars to variant, remove grammar_external, handle exception internally

* Make code less C++y

Co-authored-by: Georgi Gerganov <redacted>
33 files changed:
common/arg.cpp
common/chat-auto-parser-generator.cpp
common/chat-auto-parser-helpers.cpp
common/chat-auto-parser-helpers.h
common/chat-auto-parser.h
common/chat-diff-analyzer.cpp
common/chat-peg-parser.cpp
common/chat.cpp
common/chat.h
common/common.h
common/reasoning-budget.cpp
common/reasoning-budget.h
common/sampling.cpp
docs/autoparser.md
models/templates/Apriel-1.6-15b-Thinker-fixed.jinja
models/templates/deepseek-ai-DeepSeek-R1-Distill-Qwen-32B.jinja
models/templates/deepseek-ai-DeepSeek-V3.1.jinja
models/templates/llama-cpp-deepseek-r1.jinja
models/templates/meetkai-functionary-medium-v3.1.jinja
tests/test-chat-auto-parser.cpp
tests/test-chat-peg-parser.cpp
tests/test-chat.cpp
tools/cli/cli.cpp
tools/parser/debug-template-parser.cpp
tools/parser/template-analysis.cpp
tools/server/README.md
tools/server/public/index.html.gz
tools/server/server-common.cpp
tools/server/server-context.cpp
tools/server/server-task.cpp
tools/server/tests/unit/test_chat_completion.py
tools/server/webui/src/lib/services/parameter-sync.service.spec.ts
tools/server/webui/src/lib/types/api.d.ts