]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 12247f4)
llama : add support for control vectors (#5970)
authorTheia Vogel <redacted>
Fri, 15 Mar 2024 20:43:02 +0000 (13:43 -0700)
committerGitHub <redacted>
Fri, 15 Mar 2024 20:43:02 +0000 (22:43 +0200)
commit877b4d0c628cc70dddb5df72ed8fc14d126ca7e8
tree4de9f5a609b1d064646521f8fc94df5f884cd8fdtree
parent12247f4c69a173b9482f68aaa174ec37fc909ccfcommit | diff
llama : add support for control vectors (#5970)

* control vector api and implementation

* control-vectors : minor code style updates

* disable control vector when data == nullptr

use -1 for disabled range (also on init) in case we ever support controlling layer 0 (embeddings)

---------

Co-authored-by: Georgi Gerganov <redacted>
common/common.cpp diff | blob | history
common/common.h diff | blob | history
llama.cpp diff | blob | history
llama.h diff | blob | history
Packaging of ggml-org/llama.cpp