]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
convert : add Poro-34B-chat tokenizer support (#7713)
authorElaine <redacted>
Fri, 14 Jun 2024 10:16:49 +0000 (13:16 +0300)
committerGitHub <redacted>
Fri, 14 Jun 2024 10:16:49 +0000 (13:16 +0300)
commit41b9260f18eb7f325c952006ac46afc1d0d8ad2f
treeb5f1efc8d59d9433892cfef23c697dd20e912f6b
parent172c8256840ffd882ab9992ecedbb587d9b21f15
convert : add Poro-34B-chat tokenizer support (#7713)

* support for Poro chat pre-tokenizer

* add support for Poro pre-tokenizer

* Update convert-hf-to-gguf-update.py

Co-authored-by: Georgi Gerganov <redacted>
* Change Poro-34B-chat to poro-chat

* Change Poro-34B-chat to poro-chat

* Update convert-hf-to-gguf-update.py

* Update llama.cpp

---------

Co-authored-by: Georgi Gerganov <redacted>
convert-hf-to-gguf-update.py
convert-hf-to-gguf.py
llama.cpp
llama.h