]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
examples : restore the functionality to import llama2.c models (#2685)
authorOlivier Chafik <redacted>
Wed, 23 Aug 2023 19:33:05 +0000 (20:33 +0100)
committerGitHub <redacted>
Wed, 23 Aug 2023 19:33:05 +0000 (22:33 +0300)
commit95385241a91a616788a3bb76d12c9b7b2379ca2d
treec58bfb2b9299889474b12a2762dc4c15d19683c0
parent335acd2ffd7b04501c6d8773ab9fcee6e7bf8639
examples : restore the functionality to import llama2.c models (#2685)

* Fix import of llama2.c models that don't share weights between embedding layers

* llama2c: reinstate ggmlv3 conversion output + update readme w/ gguf conv

* llama2.c: comment out legacy "load from ggml model" logic

* llama2.c: convert special-cased "<0xXX>" single byte tokens from tokenizer.bin
examples/convert-llama2c-to-ggml/README.md
examples/convert-llama2c-to-ggml/convert-llama2c-to-ggml.cpp