]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
convert : add support for XLMRoberta embedding models (#8658)
authorDouglas Hanley <redacted>
Tue, 6 Aug 2024 07:20:54 +0000 (02:20 -0500)
committerGitHub <redacted>
Tue, 6 Aug 2024 07:20:54 +0000 (10:20 +0300)
commitcdd1889de62a7140c8c016405ec917464bde8bd3
tree98547a5c3a6fc9bc423cbb861110963cdfd1cd12
parentc21a896405de4cdf4207eb8130555ceaac0ab110
convert : add support for XLMRoberta embedding models (#8658)

* add conversion for bge-m3; small fix in unigram tokenizer

* clean up and simplify XLMRoberta conversion
convert_hf_to_gguf.py
src/llama-vocab.cpp