]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
convert : allow conversion of Mistral HF models (#6144)
authorPedro Cuenca <redacted>
Fri, 29 Mar 2024 07:15:00 +0000 (08:15 +0100)
committerGitHub <redacted>
Fri, 29 Mar 2024 07:15:00 +0000 (09:15 +0200)
commitb75c38166cf0c66793a32d5c3d6cb69929dd083d
treecd13af30af2206189ee76402e95935e345a4e83e
parentbfe7dafc9cf96b9a09ead347fed9a547930fc631
convert : allow conversion of Mistral HF models (#6144)

* Allow conversion of Mistral HF models

* Homogenize Llama, Mistral, Mixtral under the same entry.

* Fix tokenizer, permute tensors

* Use sentencepiece tokenizer, or fall back to hfft.

* convert-hf : small fix for mypy

* convert-hf : fix duplicated block_count

* convert-hf : add vocab size to metadata

---------

Co-authored-by: Jared Van Bortel <redacted>
convert-hf-to-gguf.py