]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 243532e)
vocab: add gemma4 tokenizer tests, fix edge case (#21534)
authorPiotr Wilkin (ilintar) <redacted>
Thu, 9 Apr 2026 09:41:14 +0000 (11:41 +0200)
committerGitHub <redacted>
Thu, 9 Apr 2026 09:41:14 +0000 (11:41 +0200)
commit0ec191e1d761a4daec873dfd73278ee356944fe5
tree5f042548f090bc50da9c917dc2db95e43825f1e5tree
parent243532e5568704ced8b08136e70247f9ceecdbf7commit | diff
vocab: add gemma4 tokenizer tests, fix edge case (#21534)

* YATF (Yet Another Tokenizer Fix) for Gemma 4. With tests!
* Remove unnecessary hash  from update script.
* minor: move constant
models/ggml-vocab-gemma-4.gguf [new file with mode: 0644] blob
models/ggml-vocab-gemma-4.gguf.inp [new file with mode: 0644] blob
models/ggml-vocab-gemma-4.gguf.out [new file with mode: 0644] blob
src/llama-vocab.cpp diff | blob | history
tests/CMakeLists.txt diff | blob | history
Packaging of ggml-org/llama.cpp