]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
common : inhibit lazy grammar sampler while reasoning is active (#20970)
authorAldehir Rojas <redacted>
Fri, 27 Mar 2026 17:30:40 +0000 (12:30 -0500)
committerGitHub <redacted>
Fri, 27 Mar 2026 17:30:40 +0000 (18:30 +0100)
commit59d840209a5195c2f6e2e81b5f8339a0637b59d9
tree423043eb7ad707795c975c2d43f2bedc9aa17ef2
parentff934e29bc1d102bb77418f4c83a79d954220753
common : inhibit lazy grammar sampler while reasoning is active (#20970)

* common : inhibit grammar while reasoning budget is active

* cont : update force_pos in accept

* cont : fix tests

* cont : tweak should apply logic

* cont : return early not using grammar sampler

* Add tests

* cont : prevent backend sampling when reasoning budget enabled

* cont : fix typo

---------

Co-authored-by: Piotr Wilkin <redacted>
common/reasoning-budget.cpp
common/reasoning-budget.h
common/sampling.cpp
tests/test-chat.cpp
tests/test-reasoning-budget.cpp
tools/cli/cli.cpp
tools/server/server-common.cpp
tools/server/server-task.cpp