]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llama : add support for GritLM (#5959)
authorDAN™ <redacted>
Sun, 10 Mar 2024 15:56:30 +0000 (11:56 -0400)
committerGitHub <redacted>
Sun, 10 Mar 2024 15:56:30 +0000 (17:56 +0200)
commitbcebd7dbf62fd7b293d5ed089023e4e733269c71
treeda8a1c4a76dfa9044a2bda8d1c58caaedd34bf4d
parent2960eae847f8dbde23be6d170a61bcf44ebf32de
llama : add support for GritLM (#5959)

* add gritlm example

* gritlm results match

* tabs to spaces

* comment out debug printing

* rebase to new embed

* gritlm embeddings are back babeee

* add to gitignore

* allow to toggle embedding mode

* Clean-up GritLM sample code.

* Fix types.

* Flush stdout and output ending newline if streaming.

* mostly style fixes; correct KQ_mask comment

* add causal_attn flag to llama_cparams

* gritml : minor

* llama : minor

---------

Co-authored-by: Douglas Hanley <redacted>
Co-authored-by: Georgi Gerganov <redacted>
.gitignore
Makefile
examples/CMakeLists.txt
examples/gritlm/CMakeLists.txt [new file with mode: 0644]
examples/gritlm/gritlm.cpp [new file with mode: 0644]
llama.cpp
llama.h