]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 3c26a16)
py : add Phi-1.5/Phi-2 tokenizer (#9361)
authordaminho <redacted>
Thu, 12 Sep 2024 11:28:20 +0000 (20:28 +0900)
committerGitHub <redacted>
Thu, 12 Sep 2024 11:28:20 +0000 (14:28 +0300)
commitc837981bba7cf6839b69d32b25552ce685936b14
treefdd113e0dc3ac233bd8c894dc8255cbba1106286tree
parent3c26a1644dacfa6b5d58af550210524efd7b93fccommit | diff
py : add Phi-1.5/Phi-2 tokenizer (#9361)

* add phi2 tokenizer

* add phi name to convert_hf_to_gguf_update.py

* make tokenizer_pre consistent; llama.cpp work
convert_hf_to_gguf.py diff | blob | history
convert_hf_to_gguf_update.py diff | blob | history
Packaging of ggml-org/llama.cpp