]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
cli: new CLI experience (#17824)
authorXuan-Son Nguyen <redacted>
Wed, 10 Dec 2025 14:28:59 +0000 (15:28 +0100)
committerGitHub <redacted>
Wed, 10 Dec 2025 14:28:59 +0000 (15:28 +0100)
commit6c2131773c5975c719863a21a8195a66dea4a4d0
tree5ee74db2c2d0a90518548a520cdc20c87adf291b
parentb6777218198888ed4b18d839e805f887562a9be4
cli: new CLI experience (#17824)

* wip

* wip

* fix logging, add display info

* handle commands

* add args

* wip

* move old cli to llama-completion

* rm deprecation notice

* move server to a shared library

* move ci to llama-completion

* add loading animation

* add --show-timings arg

* add /read command, improve LOG_ERR

* add args for speculative decoding, enable show timings by default

* add arg --image and --audio

* fix windows build

* support reasoning_content

* fix llama2c workflow

* color default is auto

* fix merge conflicts

* properly fix color problem

Co-authored-by: bandoti <redacted>
* better loading spinner

* make sure to clean color on force-exit

* also clear input files on "/clear"

* simplify common_log_flush

* add warning in mtmd-cli

* implement console writter

* fix data race

* add attribute

* fix llama-completion and mtmd-cli

* add some notes about console::log

* fix compilation

---------

Co-authored-by: bandoti <redacted>
29 files changed:
.github/workflows/build.yml
README.md
ci/run.sh
common/arg.cpp
common/common.h
common/console.cpp
common/console.h
common/log.cpp
common/log.h
examples/gen-docs/gen-docs.cpp
scripts/snapdragon/adb/run-cli.sh
tests/test-lora-conversion-inference.sh
tools/CMakeLists.txt
tools/cli/CMakeLists.txt [new file with mode: 0644]
tools/cli/cli.cpp [new file with mode: 0644]
tools/completion/CMakeLists.txt [new file with mode: 0644]
tools/completion/README.md [new file with mode: 0644]
tools/completion/completion.cpp [new file with mode: 0644]
tools/gguf-split/tests.sh
tools/main/CMakeLists.txt [deleted file]
tools/main/README.md [deleted file]
tools/main/main.cpp [deleted file]
tools/mtmd/mtmd-cli.cpp
tools/quantize/tests.sh
tools/server/CMakeLists.txt
tools/server/server-context.cpp
tools/server/server-context.h
tools/server/server-queue.h
tools/server/server-task.h