]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
lookahead : add example for lookahead decoding (#4207)
authorGeorgi Gerganov <redacted>
Sun, 26 Nov 2023 18:33:07 +0000 (20:33 +0200)
committerGitHub <redacted>
Sun, 26 Nov 2023 18:33:07 +0000 (20:33 +0200)
commit922754a8d60080e956891f6cee1fb03aa48d57c6
tree8eeb7ba4e6f353ba2681a63f98536c27830c8f6d
parent22da05536ff4ad963080773bef1fb839fdab95d3
lookahead : add example for lookahead decoding (#4207)

* lookahead : init

* lookahead : generate and store n-grams

* lookahead : use loop instead recursion to generate n-grams

* lookahead : initial working implementation

* lookahead : filter repeating n-grams

* lookahead : use deterministic init

* lookahead : add to Makefile

* lookahead : fix a bug in the seq_id of the lookahead tokens

* lookahead : add comments

---------

Co-authored-by: slaren <redacted>
.gitignore
Makefile
examples/CMakeLists.txt
examples/lookahead/CMakeLists.txt [new file with mode: 0644]
examples/lookahead/lookahead.cpp [new file with mode: 0644]