git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit

overview / pkg / ggml / sources / llama.cpp / commit

author	fairydreaming <redacted>
	Mon, 5 Aug 2024 07:38:01 +0000 (09:38 +0200)
committer	GitHub <redacted>
	Mon, 5 Aug 2024 07:38:01 +0000 (09:38 +0200)
commit	d3f0c7166adfa952237e0f437a5344362d8256d4
tree	a0e1bbdc48179c861a52de1fc1f80bc6dda79bf2	tree
parent	e31a4f679779220312c165b0f5994c680a610e38	commit \| diff

Stop the generation when <|eom_id|> token is encountered - needed for Llama 3.1 tool call support (#8858)

* gguf-py, llama : add constants and methods related to Llama-3.1 <|eom_id|> token

* llama : find Llama-3.1 <|eom_id|> token id during vocab loading

* llama-vocab : add Llama-3.1 <|eom_id|> token to the set of tokens stopping the generation

---------

Co-authored-by: Stanisław Szymczyk <redacted>

Packaging of ggml-org/llama.cpp

RSS Atom

gguf-py/gguf/constants.py		diff \| blob \| history
gguf-py/gguf/gguf_writer.py		diff \| blob \| history
src/llama-vocab.cpp		diff \| blob \| history
src/llama-vocab.h		diff \| blob \| history
src/llama.cpp		diff \| blob \| history