]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
convert : add BPE pre-tokenization for DBRX (#7132)
authorDAN™ <redacted>
Wed, 8 May 2024 10:43:23 +0000 (06:43 -0400)
committerGitHub <redacted>
Wed, 8 May 2024 10:43:23 +0000 (13:43 +0300)
commit4cd621c26de2095cd7c4464bdec5fe2e696ef3f3
tree9949775dc9a6ae5c5d1d0370137b1f2bfaf86f62
parent7e0b6a7b3ba94ff624dc27c1e0e735fded8819b8
convert : add BPE pre-tokenization for DBRX (#7132)

* Add BPE pre-tokenization for DBRX.

* Add vocab GGUFs.

* Remove test.

* Remove GGUFs.
convert-hf-to-gguf-update.py
convert-hf-to-gguf.py
llama.cpp
llama.h