]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
examples : update llama2.c converter to read vocab and write models in GGUF format...
authorOlivier Chafik <redacted>
Sun, 27 Aug 2023 14:13:31 +0000 (15:13 +0100)
committerGitHub <redacted>
Sun, 27 Aug 2023 14:13:31 +0000 (17:13 +0300)
commit230d46c723edf5999752e4cb67fd94edb19ef9c7
tree09a7ca40641b05eb2ece183c9a3ead9d9e92189c
parent463173a6c0ff353055eb90665794884c888c790f
examples : update llama2.c converter to read vocab and write models in GGUF format (#2751)

* llama2.c: direct gguf output (WIP)

* Simplify vector building logic

* llama2.c gguf conversion: fix token types in converter

* llama2.c: support copying vocab from a llama gguf model file

* llama2.c: update default path for vocab model + readme

* llama2.c: use defines for gguf keys

* llama2.c: escape whitespaces w/ U+2581 in vocab converter the llama.cpp way

* llama2.c converter: cleanups + take n_ff from config
examples/convert-llama2c-to-ggml/README.md
examples/convert-llama2c-to-ggml/convert-llama2c-to-ggml.cpp