]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llava : expose as a shared library for downstream projects (#3613)
authorDamian Stewart <redacted>
Mon, 6 Nov 2023 21:36:23 +0000 (22:36 +0100)
committerGitHub <redacted>
Mon, 6 Nov 2023 21:36:23 +0000 (00:36 +0300)
commit381efbf480959bb6d1e247a8b0c2328f22e350f8
treee6ad3f01c2b681b5af7300d0d5c8650fbfe1eeaa
parent2833a6f63c1b87c7f4ac574bcf7a15a2f3bf3ede
llava : expose as a shared library for downstream projects (#3613)

* wip llava python bindings compatibility

* add external llava API

* add base64 in-prompt image support

* wip refactor image loading

* refactor image load out of llava init

* cleanup

* further cleanup; move llava-cli into its own file and rename

* move base64.hpp into common/

* collapse clip and llava libraries

* move llava into its own subdir

* wip

* fix bug where base64 string was not removed from the prompt

* get libllava to output in the right place

* expose llava methods in libllama.dylib

* cleanup memory usage around clip_image_*

* cleanup and refactor *again*

* update headerdoc

* build with cmake, not tested (WIP)

* Editorconfig

* Editorconfig

* Build with make

* Build with make

* Fix cyclical depts on Windows

* attempt to fix build on Windows

* attempt to fix build on Windows

* Upd TODOs

* attempt to fix build on Windows+CUDA

* Revert changes in cmake

* Fix according to review comments

* Support building as a shared library

* address review comments

---------

Co-authored-by: M. Yusuf Sarıgöz <redacted>
Co-authored-by: Jared Van Bortel <redacted>
13 files changed:
.gitignore
Makefile
common/CMakeLists.txt
common/base64.hpp [new file with mode: 0644]
examples/llava/CMakeLists.txt
examples/llava/README.md
examples/llava/clip.cpp
examples/llava/clip.h
examples/llava/llava-cli.cpp [new file with mode: 0644]
examples/llava/llava-utils.h [deleted file]
examples/llava/llava.cpp
examples/llava/llava.h [new file with mode: 0644]
examples/server/CMakeLists.txt