]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llama-vocab : add SuperBPE pre-tokenizer (#12532)
authorcompilade <redacted>
Mon, 24 Mar 2025 10:47:24 +0000 (06:47 -0400)
committerGitHub <redacted>
Mon, 24 Mar 2025 10:47:24 +0000 (11:47 +0100)
commit00d53800e00bb22a26bf710fa6bd1150e412cc1d
treebc4eebf57a94c3718f5e9f562d693312a2c52798
parent7ea75035b67f44c22ed7039967f718011fd35ce5
llama-vocab : add SuperBPE pre-tokenizer (#12532)
convert_hf_to_gguf.py
convert_hf_to_gguf_update.py
include/llama.h
src/llama-vocab.cpp