]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 5a42a5f)
Add test for MPT tokenization (#3728)
authorgoerch <redacted>
Sun, 22 Oct 2023 19:21:42 +0000 (21:21 +0200)
committerGitHub <redacted>
Sun, 22 Oct 2023 19:21:42 +0000 (21:21 +0200)
commit9e70cc03229df19ca2d28ce23cc817198f897278
tree0c027b73d2efc94260b41e2227a1318e2c9ba23dtree
parent5a42a5f8e8a86da9ac88008d748cf232a83aa0e1commit | diff
Add test for MPT tokenization (#3728)

* Add test for MPT tokenization

* Revert code motion

* Remove unnecessary restriction in test case

* Clarify logic in conversion
convert-mpt-hf-to-gguf.py diff | blob | history
llama.cpp diff | blob | history
models/ggml-vocab-mpt.gguf [new file with mode: 0644] blob
tests/CMakeLists.txt diff | blob | history
Packaging of ggml-org/llama.cpp