]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 7593639)
gguf : add special tokens metadata for FIM/Infill (#6689)
authorDaniel Bevenius <redacted>
Tue, 16 Apr 2024 06:13:13 +0000 (08:13 +0200)
committerGitHub <redacted>
Tue, 16 Apr 2024 06:13:13 +0000 (09:13 +0300)
commit4fbd8098e63670c6ae11a8adc350f5ba191cfda3
tree2b788b46bac8408336d12594ffd39ee2cad1cf2dtree
parent7593639ce335e8d7f89aa9a54d616951f273af60commit | diff
gguf : add special tokens metadata for FIM/Infill (#6689)

This commit adds special token metadata for Fill-In-the-Middle
(FIM)/Infill to the GGUF model.

The motivation for this is that currently there is support for CodeLlama
but other models exist now like CodeGemma, but the different models use
different token ids for the special tokens and this commit allows for
supporting multiple models.

Signed-off-by: Daniel Bevenius <redacted>
convert-hf-to-gguf.py diff | blob | history
gguf-py/gguf/constants.py diff | blob | history
gguf-py/gguf/gguf_writer.py diff | blob | history
llama.cpp diff | blob | history
Packaging of ggml-org/llama.cpp