]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: dae06c0)
speculative : fix prompt tokenization in speculative example (#4025)
authorBranden Butler <redacted>
Mon, 20 Nov 2023 09:50:04 +0000 (03:50 -0600)
committerGitHub <redacted>
Mon, 20 Nov 2023 09:50:04 +0000 (11:50 +0200)
commit40a34fe8d034bd484efd79ccbb95059ca6308dcb
treed764cf818b68c98228a2db8bde539241dce78f6ctree
parentdae06c06e5c6232ae2be4d567dd5101e1e96c814commit | diff
speculative : fix prompt tokenization in speculative example (#4025)

* Support special tokens and not adding BOS to prompt in speculative

* Adapt to new should_add_bos function

* Ensure tgt and dft have same add_bos setting
examples/speculative/speculative.cpp diff | blob | history
Packaging of ggml-org/llama.cpp