]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
grammar : check the full vocab only if necessary (opt) (#4306)
authorkalomaze <redacted>
Sat, 23 Dec 2023 09:27:07 +0000 (03:27 -0600)
committerGitHub <redacted>
Sat, 23 Dec 2023 09:27:07 +0000 (11:27 +0200)
commitb9ec82d262cb20d7f0a8a1157bfa9aace40e2625
treed2040853479940cbb5343295e0115dda16b0d96d
parente0a4002273907b2c414b6b5442d99e08bfe2df35
grammar : check the full vocab only if necessary (opt) (#4306)

* Check the full vocab for grammar only if necessary

* Fix missing logit restoration step (?)

Does this matter, actually?

* Fix whitespace / formatting

* Adjust comment

* Didn't mean to push test gbnf

* Split sampling into the helper function (?)

And also revert the changes made to the header

* common : fix final newline

---------

Co-authored-by: Georgi Gerganov <redacted>
common/sampling.cpp