]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llava-cli : refactor to use sampling library (#4669)
authorJustine Tunney <redacted>
Fri, 29 Dec 2023 14:38:38 +0000 (06:38 -0800)
committerGitHub <redacted>
Fri, 29 Dec 2023 14:38:38 +0000 (16:38 +0200)
commit4af4801566bc262a38fb77f51edf278ac323c2bd
treeadefcd515c9cdafbf9bb7c6755c2b77b14ef4b9e
parentdb49ff8ed7f0bb201176703441cc02911b08ef2a
llava-cli : refactor to use sampling library (#4669)

This change makes it possible to use flags like `--grammar` when using
the `llava-cli` program. The rest is just code cleanup deleting a long
standing TODO comment.

This change also ensures that logging information is emitted to stderr
which helps the `llava-cli` command be more friendly to shell scripts.

See Mozilla-Ocho/llamafile@1cd334f
examples/llava/llava-cli.cpp