]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
convert : handle tokenizer merges format from transformers 4.45 (#9696)
authorcompilade <redacted>
Thu, 3 Oct 2024 14:22:15 +0000 (10:22 -0400)
committerGitHub <redacted>
Thu, 3 Oct 2024 14:22:15 +0000 (17:22 +0300)
commite3c355ba654d4164c1c09e5d0dcacecb8b214af8
treee011900a4068d5d7446fa098394ce28454b47743
parent841713e1e487bdb82fd106a52ad998c5f87b59e9
convert : handle tokenizer merges format from transformers 4.45 (#9696)
gguf-py/gguf/vocab.py