]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 38d16b1)
llama : add StarCoder2 support (#5795)
authorSourab Mangrulkar <redacted>
Fri, 1 Mar 2024 19:30:46 +0000 (01:00 +0530)
committerGitHub <redacted>
Fri, 1 Mar 2024 19:30:46 +0000 (21:30 +0200)
commitc29af7e2252d288f2ea58a7d437c1cb7c0abf160
treeb17451289ae835cb33f10c79db82a1e91004e225tree
parent38d16b142624bdd7c41d9955752b7f7b59c5e048commit | diff
llama : add StarCoder2 support (#5795)

* Add support for starcoder2

* handle rope type

* skip rope freq and rotary embeddings from being serialized

* resolve comments

* Update llama.cpp

* remove redundant changes

* handle `rope-theta`

* llama : change starcoder2 rope type

* address comment

---------

Co-authored-by: Georgi Gerganov <redacted>
convert-hf-to-gguf.py diff | blob | history
gguf-py/gguf/constants.py diff | blob | history
gguf-py/gguf/tensor_mapping.py diff | blob | history
llama.cpp diff | blob | history
Packaging of ggml-org/llama.cpp