]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
vocab : add byte token handling to BPE detokenizer for Gemma4 (#21488)
authorAldehir Rojas <redacted>
Mon, 6 Apr 2026 14:08:37 +0000 (09:08 -0500)
committerGitHub <redacted>
Mon, 6 Apr 2026 14:08:37 +0000 (09:08 -0500)
commit4aa962e2b0d04e6be6944f899edbdbe26177e492
tree823298e13584bc57760e44267ce80c0b989be34e
parent941146b3f1ebcd54f125f1f80598f29231155989
vocab : add byte token handling to BPE detokenizer for Gemma4 (#21488)
src/llama-vocab.cpp