]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 0d41771)
fix(gguf-py): special tokens are no longer skipped when add_<token>_token is set...
authorMichaël de Vries <redacted>
Thu, 15 Feb 2024 13:14:37 +0000 (14:14 +0100)
committerGitHub <redacted>
Thu, 15 Feb 2024 13:14:37 +0000 (14:14 +0100)
commit73122473ffd73030146276dbb85da7c8021a3ee4
tree51544fef2e4d934553a5569eab83e385622cfd46tree
parent0d4177126b0556e202efb85bf3f768be81076400commit | diff
fix(gguf-py): special tokens are no longer skipped when add_<token>_token is set to false (#5487)

* fix(gguf-py): special tokens are no longer skipped when add_<token>_token is set to false

* fix(gguf-py): added missing cls and mask token ids to the gguf metadata
gguf-py/gguf/constants.py diff | blob | history
gguf-py/gguf/gguf_writer.py diff | blob | history
gguf-py/gguf/vocab.py diff | blob | history
Packaging of ggml-org/llama.cpp