]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 917dc8c)
Tokenizer SPM fixes for phi-3 and llama-spm (bugfix) (#7425)
authorjaime-m-p <redacted>
Tue, 21 May 2024 12:39:48 +0000 (14:39 +0200)
committerGitHub <redacted>
Tue, 21 May 2024 12:39:48 +0000 (14:39 +0200)
commitd7e852c1bc8e85bf62a6f1aede08cd2de723404a
tree46323a83d73f66727459aee88a995e946a78e005tree
parent917dc8cfa67a72fb7c8bf7392270da3bf4833af4commit | diff
Tokenizer SPM fixes for phi-3 and llama-spm (bugfix) (#7425)

* Update brute force test: add_special
* Update brute force test: default values for add_bos_token and add_eos_token
* Enable rtrim when pre-inserting BOS

Co-authored-by: Georgi Gerganov <redacted>
* Revert "server : fix test regexes"
convert-hf-to-gguf.py diff | blob | history
examples/server/tests/features/server.feature diff | blob | history
examples/server/tests/features/slotsave.feature diff | blob | history
llama.cpp diff | blob | history
tests/test-tokenizer-random.py diff | blob | history
Packaging of ggml-org/llama.cpp