]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
tests : re-enable tokenizer tests (#8611)
authorGeorgi Gerganov <redacted>
Mon, 22 Jul 2024 10:32:49 +0000 (13:32 +0300)
committerGitHub <redacted>
Mon, 22 Jul 2024 10:32:49 +0000 (13:32 +0300)
commite093dd238282a980d248db0786063f8174400f70
tree95b1252a4d56a4280d29dbdbb524cca02efd0fe9
parent50e05353e88d50b644688caa91f5955e8bdb9eb9
tests : re-enable tokenizer tests (#8611)

* models : remove duplicated gpt-2 vocab

* models : remove old stablelm vocab

* tests : re-enable MPT tokenizer tests

* tests : re-enable DeepSeek tokenizer tests

* cmake : sort

ggml-ci
models/ggml-vocab-gpt2.gguf [deleted file]
models/ggml-vocab-stablelm.gguf [deleted file]
tests/CMakeLists.txt