]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 2ba85c8)
speculative : add grammar support (#2991)
authorGeorgi Gerganov <redacted>
Tue, 5 Sep 2023 05:46:17 +0000 (08:46 +0300)
committerGitHub <redacted>
Tue, 5 Sep 2023 05:46:17 +0000 (08:46 +0300)
commit921772104ba2219bfdc2b2980d05ebc0aa0c92a4
treec9ba8f0f8d0471c9c3c85a6963b322affa0f4f97tree
parent2ba85c8609309a59d49c45ab43c31800b7ba141ccommit | diff
speculative : add grammar support (#2991)

* speculative : add grammar support

* grammars : add json_arr.gbnf

* grammar : add comments to new grammar file

* grammar : remove one nested level

* common : warm-up with 2 tokens - seems to work better

* speculative : print draft token pieces

* speculative : reuse grammar parser + better logs and comments

* speculative : avoid grammar_mem

* make : fix speculative build
Makefile diff | blob | history
common/common.cpp diff | blob | history
examples/speculative/speculative.cpp diff | blob | history
grammars/json_arr.gbnf [new file with mode: 0644] blob
llama.cpp diff | blob | history
llama.h diff | blob | history
Packaging of ggml-org/llama.cpp