]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 9d23589)
llama : support input embeddings directly (#1910)
authorningshanwutuobang <redacted>
Wed, 28 Jun 2023 15:53:37 +0000 (23:53 +0800)
committerGitHub <redacted>
Wed, 28 Jun 2023 15:53:37 +0000 (18:53 +0300)
commitcfa0750bc9dbc2d957a91b8ed09ab0035d8f3d4e
treec8d6d6e6548d4f03899704f64bce6939e471e4e6tree
parent9d23589d638dc74577d5ff880e6d4248b795f12ecommit | diff
llama : support input embeddings directly  (#1910)

* add interface for float input

* fixed inpL shape and type

* add examples of input floats

* add test example for embd input

* fixed sampling

* add free for context

* fixed add end condition for generating

* add examples for llava.py

* add READMD for llava.py

* add READMD for llava.py

* add example of PandaGPT

* refactor the interface and fixed the styles

* add cmake build for embd-input

* add cmake build for embd-input

* Add MiniGPT-4 example

* change the order of the args of llama_eval_internal

* fix ci error
16 files changed:
.gitignore diff | blob | history
Makefile diff | blob | history
convert-lora-to-ggml.py diff | blob | history
examples/CMakeLists.txt diff | blob | history
examples/embd-input/.gitignore [new file with mode: 0644] blob
examples/embd-input/CMakeLists.txt [new file with mode: 0644] blob
examples/embd-input/README.md [new file with mode: 0644] blob
examples/embd-input/embd-input-lib.cpp [new file with mode: 0644] blob
examples/embd-input/embd-input-test.cpp [new file with mode: 0644] blob
examples/embd-input/embd-input.h [new file with mode: 0644] blob
examples/embd-input/embd_input.py [new file with mode: 0644] blob
examples/embd-input/llava.py [new file with mode: 0644] blob
examples/embd-input/minigpt4.py [new file with mode: 0644] blob
examples/embd-input/panda_gpt.py [new file with mode: 0644] blob
llama.cpp diff | blob | history
llama.h diff | blob | history
Packaging of ggml-org/llama.cpp