]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 566daa5)
llama : add support for SmolLm pre-tokenizer (#8609)
authorJason Stillerman <redacted>
Mon, 22 Jul 2024 14:43:01 +0000 (10:43 -0400)
committerGitHub <redacted>
Mon, 22 Jul 2024 14:43:01 +0000 (17:43 +0300)
commitd94c6e0ccbd29ee1ba4f44e9caa8682ad94df9fa
treed7be34a37ed3fd7d3448b059a31e9279b063636ctree
parent566daa5a5b38018b2727950bbd280239adb981b6commit | diff
llama : add support for SmolLm pre-tokenizer (#8609)

* Adding SmolLM Pre Tokenizer

* Update convert_hf_to_gguf_update.py

Co-authored-by: compilade <redacted>
* Update src/llama.cpp

Co-authored-by: compilade <redacted>
* handle regex

* removed .inp and out .out ggufs

---------

Co-authored-by: compilade <redacted>
convert_hf_to_gguf.py diff | blob | history
convert_hf_to_gguf_update.py diff | blob | history
include/llama.h diff | blob | history
src/llama.cpp diff | blob | history
Packaging of ggml-org/llama.cpp