]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llama : move end-user examples to tools directory (#13249)
authorDiego Devesa <redacted>
Fri, 2 May 2025 18:27:13 +0000 (20:27 +0200)
committerGitHub <redacted>
Fri, 2 May 2025 18:27:13 +0000 (20:27 +0200)
commit1d36b3670b285e69e58b9d687c770a2a0a192194
treea510b2a686d850dde8a4da94b74fc718df8d8b9c
parentb34443923cad751483cc53af2e680d595daadce7
llama : move end-user examples to tools directory (#13249)

* llama : move end-user examples to tools directory

---------

Co-authored-by: Xuan Son Nguyen <redacted>
389 files changed:
.editorconfig
.flake8
.github/labeler.yml
.github/workflows/bench.yml.disabled
.github/workflows/build-linux-cross.yml
.github/workflows/build.yml
.github/workflows/server.yml
.gitignore
CMakeLists.txt
CODEOWNERS
Makefile
README.md
SECURITY.md
build-xcframework.sh
ci/run.sh
common/arg.cpp
common/common.h
docs/development/HOWTO-add-model.md
docs/multimodal/MobileVLM.md
docs/multimodal/glmedge.md
docs/multimodal/llava.md
docs/multimodal/minicpmo2.6.md
docs/multimodal/minicpmv2.5.md
docs/multimodal/minicpmv2.6.md
examples/CMakeLists.txt
examples/batched-bench/CMakeLists.txt [deleted file]
examples/batched-bench/README.md [deleted file]
examples/batched-bench/batched-bench.cpp [deleted file]
examples/cvector-generator/CMakeLists.txt [deleted file]
examples/cvector-generator/README.md [deleted file]
examples/cvector-generator/completions.txt [deleted file]
examples/cvector-generator/cvector-generator.cpp [deleted file]
examples/cvector-generator/mean.hpp [deleted file]
examples/cvector-generator/negative.txt [deleted file]
examples/cvector-generator/pca.hpp [deleted file]
examples/cvector-generator/positive.txt [deleted file]
examples/export-lora/CMakeLists.txt [deleted file]
examples/export-lora/README.md [deleted file]
examples/export-lora/export-lora.cpp [deleted file]
examples/gguf-split/CMakeLists.txt [deleted file]
examples/gguf-split/README.md [deleted file]
examples/gguf-split/gguf-split.cpp [deleted file]
examples/gguf-split/tests.sh [deleted file]
examples/imatrix/CMakeLists.txt [deleted file]
examples/imatrix/README.md [deleted file]
examples/imatrix/imatrix.cpp [deleted file]
examples/llama-bench/CMakeLists.txt [deleted file]
examples/llama-bench/README.md [deleted file]
examples/llama-bench/llama-bench.cpp [deleted file]
examples/llava/CMakeLists.txt [deleted file]
examples/llava/README-quantize.md [deleted file]
examples/llava/README.md [deleted file]
examples/llava/android/adb_run.sh [deleted file]
examples/llava/android/build_64.sh [deleted file]
examples/llava/clip-impl.h [deleted file]
examples/llava/clip-quantize-cli.cpp [deleted file]
examples/llava/clip.cpp [deleted file]
examples/llava/clip.h [deleted file]
examples/llava/convert_image_encoder_to_gguf.py [deleted file]
examples/llava/deprecation-warning.cpp [deleted file]
examples/llava/glmedge-convert-image-encoder-to-gguf.py [deleted file]
examples/llava/glmedge-surgery.py [deleted file]
examples/llava/llava.cpp [deleted file]
examples/llava/llava.h [deleted file]
examples/llava/llava_surgery.py [deleted file]
examples/llava/llava_surgery_v2.py [deleted file]
examples/llava/minicpmv-convert-image-encoder-to-gguf.py [deleted file]
examples/llava/minicpmv-surgery.py [deleted file]
examples/llava/mtmd-cli.cpp [deleted file]
examples/llava/mtmd.cpp [deleted file]
examples/llava/mtmd.h [deleted file]
examples/llava/qwen2vl-test.cpp [deleted file]
examples/llava/requirements.txt [deleted file]
examples/llava/test-1.jpeg [deleted file]
examples/llava/tests.sh [deleted file]
examples/main/CMakeLists.txt [deleted file]
examples/main/README.md [deleted file]
examples/main/main.cpp [deleted file]
examples/perplexity/CMakeLists.txt [deleted file]
examples/perplexity/README.md [deleted file]
examples/perplexity/perplexity.cpp [deleted file]
examples/pydantic_models_to_grammar_examples.py
examples/quantize/CMakeLists.txt [deleted file]
examples/quantize/README.md [deleted file]
examples/quantize/quantize.cpp [deleted file]
examples/quantize/tests.sh [deleted file]
examples/rpc/CMakeLists.txt [deleted file]
examples/rpc/README.md [deleted file]
examples/rpc/rpc-server.cpp [deleted file]
examples/run/CMakeLists.txt [deleted file]
examples/run/README.md [deleted file]
examples/run/linenoise.cpp/linenoise.cpp [deleted file]
examples/run/linenoise.cpp/linenoise.h [deleted file]
examples/run/run.cpp [deleted file]
examples/server/CMakeLists.txt [deleted file]
examples/server/README.md [deleted file]
examples/server/bench/README.md [deleted file]
examples/server/bench/bench.py [deleted file]
examples/server/bench/prometheus.yml [deleted file]
examples/server/bench/requirements.txt [deleted file]
examples/server/bench/script.js [deleted file]
examples/server/chat-llama2.sh [deleted file]
examples/server/chat.mjs [deleted file]
examples/server/chat.sh [deleted file]
examples/server/httplib.h [deleted file]
examples/server/public/index.html.gz [deleted file]
examples/server/public/loading.html [deleted file]
examples/server/public_legacy/colorthemes.css [deleted file]
examples/server/public_legacy/completion.js [deleted file]
examples/server/public_legacy/favicon.ico [deleted file]
examples/server/public_legacy/index-new.html [deleted file]
examples/server/public_legacy/index.html [deleted file]
examples/server/public_legacy/index.js [deleted file]
examples/server/public_legacy/json-schema-to-grammar.mjs [deleted file]
examples/server/public_legacy/loading.html [deleted file]
examples/server/public_legacy/prompt-formats.js [deleted file]
examples/server/public_legacy/style.css [deleted file]
examples/server/public_legacy/system-prompts.js [deleted file]
examples/server/public_legacy/theme-beeninorder.css [deleted file]
examples/server/public_legacy/theme-ketivah.css [deleted file]
examples/server/public_legacy/theme-mangotango.css [deleted file]
examples/server/public_legacy/theme-playground.css [deleted file]
examples/server/public_legacy/theme-polarnight.css [deleted file]
examples/server/public_legacy/theme-snowstorm.css [deleted file]
examples/server/public_simplechat/datautils.mjs [deleted file]
examples/server/public_simplechat/index.html [deleted file]
examples/server/public_simplechat/readme.md [deleted file]
examples/server/public_simplechat/simplechat.css [deleted file]
examples/server/public_simplechat/simplechat.js [deleted file]
examples/server/public_simplechat/simplechat_screens.webp [deleted file]
examples/server/public_simplechat/ui.mjs [deleted file]
examples/server/server.cpp [deleted file]
examples/server/tests/.gitignore [deleted file]
examples/server/tests/README.md [deleted file]
examples/server/tests/conftest.py [deleted file]
examples/server/tests/pytest.ini [deleted file]
examples/server/tests/requirements.txt [deleted file]
examples/server/tests/tests.sh [deleted file]
examples/server/tests/unit/test_basic.py [deleted file]
examples/server/tests/unit/test_chat_completion.py [deleted file]
examples/server/tests/unit/test_completion.py [deleted file]
examples/server/tests/unit/test_ctx_shift.py [deleted file]
examples/server/tests/unit/test_embedding.py [deleted file]
examples/server/tests/unit/test_infill.py [deleted file]
examples/server/tests/unit/test_lora.py [deleted file]
examples/server/tests/unit/test_rerank.py [deleted file]
examples/server/tests/unit/test_security.py [deleted file]
examples/server/tests/unit/test_slot_save.py [deleted file]
examples/server/tests/unit/test_speculative.py [deleted file]
examples/server/tests/unit/test_tokenize.py [deleted file]
examples/server/tests/unit/test_tool_call.py [deleted file]
examples/server/tests/utils.py [deleted file]
examples/server/themes/README.md [deleted file]
examples/server/themes/buttons-top/README.md [deleted file]
examples/server/themes/buttons-top/buttons_top.png [deleted file]
examples/server/themes/buttons-top/favicon.ico [deleted file]
examples/server/themes/buttons-top/index.html [deleted file]
examples/server/themes/wild/README.md [deleted file]
examples/server/themes/wild/favicon.ico [deleted file]
examples/server/themes/wild/index.html [deleted file]
examples/server/themes/wild/llama_cpp.png [deleted file]
examples/server/themes/wild/llamapattern.png [deleted file]
examples/server/themes/wild/wild.png [deleted file]
examples/server/utils.hpp [deleted file]
examples/server/webui/.gitignore [deleted file]
examples/server/webui/.prettierignore [deleted file]
examples/server/webui/eslint.config.js [deleted file]
examples/server/webui/index.html [deleted file]
examples/server/webui/package-lock.json [deleted file]
examples/server/webui/package.json [deleted file]
examples/server/webui/postcss.config.js [deleted file]
examples/server/webui/public/demo-conversation.json [deleted file]
examples/server/webui/src/App.tsx [deleted file]
examples/server/webui/src/Config.ts [deleted file]
examples/server/webui/src/components/CanvasPyInterpreter.tsx [deleted file]
examples/server/webui/src/components/ChatMessage.tsx [deleted file]
examples/server/webui/src/components/ChatScreen.tsx [deleted file]
examples/server/webui/src/components/Header.tsx [deleted file]
examples/server/webui/src/components/MarkdownDisplay.tsx [deleted file]
examples/server/webui/src/components/SettingDialog.tsx [deleted file]
examples/server/webui/src/components/Sidebar.tsx [deleted file]
examples/server/webui/src/components/useChatTextarea.ts [deleted file]
examples/server/webui/src/index.scss [deleted file]
examples/server/webui/src/main.tsx [deleted file]
examples/server/webui/src/utils/app.context.tsx [deleted file]
examples/server/webui/src/utils/common.tsx [deleted file]
examples/server/webui/src/utils/llama-vscode.ts [deleted file]
examples/server/webui/src/utils/misc.ts [deleted file]
examples/server/webui/src/utils/storage.ts [deleted file]
examples/server/webui/src/utils/types.ts [deleted file]
examples/server/webui/src/vite-env.d.ts [deleted file]
examples/server/webui/tailwind.config.js [deleted file]
examples/server/webui/tsconfig.app.json [deleted file]
examples/server/webui/tsconfig.json [deleted file]
examples/server/webui/tsconfig.node.json [deleted file]
examples/server/webui/vite.config.ts [deleted file]
examples/tokenize/CMakeLists.txt [deleted file]
examples/tokenize/tokenize.cpp [deleted file]
examples/tts/CMakeLists.txt [deleted file]
examples/tts/README.md [deleted file]
examples/tts/convert_pt_to_hf.py [deleted file]
examples/tts/tts-outetts.py [deleted file]
examples/tts/tts.cpp [deleted file]
grammars/README.md
pyrightconfig.json
requirements/requirements-all.txt
scripts/fetch_server_test_models.py
scripts/tool_bench.py
scripts/xxd.cmake
tests/CMakeLists.txt
tests/run-json-schema-to-grammar.mjs
tools/CMakeLists.txt [new file with mode: 0644]
tools/batched-bench/CMakeLists.txt [new file with mode: 0644]
tools/batched-bench/README.md [new file with mode: 0644]
tools/batched-bench/batched-bench.cpp [new file with mode: 0644]
tools/cvector-generator/CMakeLists.txt [new file with mode: 0644]
tools/cvector-generator/README.md [new file with mode: 0644]
tools/cvector-generator/completions.txt [new file with mode: 0644]
tools/cvector-generator/cvector-generator.cpp [new file with mode: 0644]
tools/cvector-generator/mean.hpp [new file with mode: 0644]
tools/cvector-generator/negative.txt [new file with mode: 0644]
tools/cvector-generator/pca.hpp [new file with mode: 0644]
tools/cvector-generator/positive.txt [new file with mode: 0644]
tools/export-lora/CMakeLists.txt [new file with mode: 0644]
tools/export-lora/README.md [new file with mode: 0644]
tools/export-lora/export-lora.cpp [new file with mode: 0644]
tools/gguf-split/CMakeLists.txt [new file with mode: 0644]
tools/gguf-split/README.md [new file with mode: 0644]
tools/gguf-split/gguf-split.cpp [new file with mode: 0644]
tools/gguf-split/tests.sh [new file with mode: 0755]
tools/imatrix/CMakeLists.txt [new file with mode: 0644]
tools/imatrix/README.md [new file with mode: 0644]
tools/imatrix/imatrix.cpp [new file with mode: 0644]
tools/llama-bench/CMakeLists.txt [new file with mode: 0644]
tools/llama-bench/README.md [new file with mode: 0644]
tools/llama-bench/llama-bench.cpp [new file with mode: 0644]
tools/llava/CMakeLists.txt [new file with mode: 0644]
tools/llava/README-quantize.md [new file with mode: 0644]
tools/llava/README.md [new file with mode: 0644]
tools/llava/android/adb_run.sh [new file with mode: 0755]
tools/llava/android/build_64.sh [new file with mode: 0755]
tools/llava/clip-impl.h [new file with mode: 0644]
tools/llava/clip-quantize-cli.cpp [new file with mode: 0644]
tools/llava/clip.cpp [new file with mode: 0644]
tools/llava/clip.h [new file with mode: 0644]
tools/llava/convert_image_encoder_to_gguf.py [new file with mode: 0644]
tools/llava/deprecation-warning.cpp [new file with mode: 0644]
tools/llava/glmedge-convert-image-encoder-to-gguf.py [new file with mode: 0644]
tools/llava/glmedge-surgery.py [new file with mode: 0644]
tools/llava/llava.cpp [new file with mode: 0644]
tools/llava/llava.h [new file with mode: 0644]
tools/llava/llava_surgery.py [new file with mode: 0644]
tools/llava/llava_surgery_v2.py [new file with mode: 0644]
tools/llava/minicpmv-convert-image-encoder-to-gguf.py [new file with mode: 0644]
tools/llava/minicpmv-surgery.py [new file with mode: 0644]
tools/llava/mtmd-cli.cpp [new file with mode: 0644]
tools/llava/mtmd.cpp [new file with mode: 0644]
tools/llava/mtmd.h [new file with mode: 0644]
tools/llava/qwen2vl-test.cpp [new file with mode: 0644]
tools/llava/requirements.txt [new file with mode: 0644]
tools/llava/test-1.jpeg [new file with mode: 0644]
tools/llava/tests.sh [new file with mode: 0755]
tools/main/CMakeLists.txt [new file with mode: 0644]
tools/main/README.md [new file with mode: 0644]
tools/main/main.cpp [new file with mode: 0644]
tools/perplexity/CMakeLists.txt [new file with mode: 0644]
tools/perplexity/README.md [new file with mode: 0644]
tools/perplexity/perplexity.cpp [new file with mode: 0644]
tools/quantize/CMakeLists.txt [new file with mode: 0644]
tools/quantize/README.md [new file with mode: 0644]
tools/quantize/quantize.cpp [new file with mode: 0644]
tools/quantize/tests.sh [new file with mode: 0644]
tools/rpc/CMakeLists.txt [new file with mode: 0644]
tools/rpc/README.md [new file with mode: 0644]
tools/rpc/rpc-server.cpp [new file with mode: 0644]
tools/run/CMakeLists.txt [new file with mode: 0644]
tools/run/README.md [new file with mode: 0644]
tools/run/linenoise.cpp/linenoise.cpp [new file with mode: 0644]
tools/run/linenoise.cpp/linenoise.h [new file with mode: 0644]
tools/run/run.cpp [new file with mode: 0644]
tools/server/CMakeLists.txt [new file with mode: 0644]
tools/server/README.md [new file with mode: 0644]
tools/server/bench/README.md [new file with mode: 0644]
tools/server/bench/bench.py [new file with mode: 0644]
tools/server/bench/prometheus.yml [new file with mode: 0644]
tools/server/bench/requirements.txt [new file with mode: 0644]
tools/server/bench/script.js [new file with mode: 0644]
tools/server/chat-llama2.sh [new file with mode: 0755]
tools/server/chat.mjs [new file with mode: 0644]
tools/server/chat.sh [new file with mode: 0755]
tools/server/httplib.h [new file with mode: 0644]
tools/server/public/index.html.gz [new file with mode: 0644]
tools/server/public/loading.html [new file with mode: 0644]
tools/server/public_legacy/colorthemes.css [new file with mode: 0755]
tools/server/public_legacy/completion.js [new file with mode: 0644]
tools/server/public_legacy/favicon.ico [new file with mode: 0644]
tools/server/public_legacy/index-new.html [new file with mode: 0644]
tools/server/public_legacy/index.html [new file with mode: 0644]
tools/server/public_legacy/index.js [new file with mode: 0644]
tools/server/public_legacy/json-schema-to-grammar.mjs [new file with mode: 0644]
tools/server/public_legacy/loading.html [new file with mode: 0644]
tools/server/public_legacy/prompt-formats.js [new file with mode: 0644]
tools/server/public_legacy/style.css [new file with mode: 0644]
tools/server/public_legacy/system-prompts.js [new file with mode: 0644]
tools/server/public_legacy/theme-beeninorder.css [new file with mode: 0755]
tools/server/public_legacy/theme-ketivah.css [new file with mode: 0755]
tools/server/public_legacy/theme-mangotango.css [new file with mode: 0755]
tools/server/public_legacy/theme-playground.css [new file with mode: 0755]
tools/server/public_legacy/theme-polarnight.css [new file with mode: 0755]
tools/server/public_legacy/theme-snowstorm.css [new file with mode: 0755]
tools/server/public_simplechat/datautils.mjs [new file with mode: 0644]
tools/server/public_simplechat/index.html [new file with mode: 0644]
tools/server/public_simplechat/readme.md [new file with mode: 0644]
tools/server/public_simplechat/simplechat.css [new file with mode: 0644]
tools/server/public_simplechat/simplechat.js [new file with mode: 0644]
tools/server/public_simplechat/simplechat_screens.webp [new file with mode: 0644]
tools/server/public_simplechat/ui.mjs [new file with mode: 0644]
tools/server/server.cpp [new file with mode: 0644]
tools/server/tests/.gitignore [new file with mode: 0644]
tools/server/tests/README.md [new file with mode: 0644]
tools/server/tests/conftest.py [new file with mode: 0644]
tools/server/tests/pytest.ini [new file with mode: 0644]
tools/server/tests/requirements.txt [new file with mode: 0644]
tools/server/tests/tests.sh [new file with mode: 0755]
tools/server/tests/unit/test_basic.py [new file with mode: 0644]
tools/server/tests/unit/test_chat_completion.py [new file with mode: 0644]
tools/server/tests/unit/test_completion.py [new file with mode: 0644]
tools/server/tests/unit/test_ctx_shift.py [new file with mode: 0644]
tools/server/tests/unit/test_embedding.py [new file with mode: 0644]
tools/server/tests/unit/test_infill.py [new file with mode: 0644]
tools/server/tests/unit/test_lora.py [new file with mode: 0644]
tools/server/tests/unit/test_rerank.py [new file with mode: 0644]
tools/server/tests/unit/test_security.py [new file with mode: 0644]
tools/server/tests/unit/test_slot_save.py [new file with mode: 0644]
tools/server/tests/unit/test_speculative.py [new file with mode: 0644]
tools/server/tests/unit/test_tokenize.py [new file with mode: 0644]
tools/server/tests/unit/test_tool_call.py [new file with mode: 0755]
tools/server/tests/utils.py [new file with mode: 0644]
tools/server/themes/README.md [new file with mode: 0644]
tools/server/themes/buttons-top/README.md [new file with mode: 0644]
tools/server/themes/buttons-top/buttons_top.png [new file with mode: 0644]
tools/server/themes/buttons-top/favicon.ico [new file with mode: 0644]
tools/server/themes/buttons-top/index.html [new file with mode: 0644]
tools/server/themes/wild/README.md [new file with mode: 0644]
tools/server/themes/wild/favicon.ico [new file with mode: 0644]
tools/server/themes/wild/index.html [new file with mode: 0644]
tools/server/themes/wild/llama_cpp.png [new file with mode: 0644]
tools/server/themes/wild/llamapattern.png [new file with mode: 0644]
tools/server/themes/wild/wild.png [new file with mode: 0644]
tools/server/utils.hpp [new file with mode: 0644]
tools/server/webui/.gitignore [new file with mode: 0644]
tools/server/webui/.prettierignore [new file with mode: 0644]
tools/server/webui/eslint.config.js [new file with mode: 0644]
tools/server/webui/index.html [new file with mode: 0644]
tools/server/webui/package-lock.json [new file with mode: 0644]
tools/server/webui/package.json [new file with mode: 0644]
tools/server/webui/postcss.config.js [new file with mode: 0644]
tools/server/webui/public/demo-conversation.json [new file with mode: 0644]
tools/server/webui/src/App.tsx [new file with mode: 0644]
tools/server/webui/src/Config.ts [new file with mode: 0644]
tools/server/webui/src/components/CanvasPyInterpreter.tsx [new file with mode: 0644]
tools/server/webui/src/components/ChatMessage.tsx [new file with mode: 0644]
tools/server/webui/src/components/ChatScreen.tsx [new file with mode: 0644]
tools/server/webui/src/components/Header.tsx [new file with mode: 0644]
tools/server/webui/src/components/MarkdownDisplay.tsx [new file with mode: 0644]
tools/server/webui/src/components/SettingDialog.tsx [new file with mode: 0644]
tools/server/webui/src/components/Sidebar.tsx [new file with mode: 0644]
tools/server/webui/src/components/useChatTextarea.ts [new file with mode: 0644]
tools/server/webui/src/index.scss [new file with mode: 0644]
tools/server/webui/src/main.tsx [new file with mode: 0644]
tools/server/webui/src/utils/app.context.tsx [new file with mode: 0644]
tools/server/webui/src/utils/common.tsx [new file with mode: 0644]
tools/server/webui/src/utils/llama-vscode.ts [new file with mode: 0644]
tools/server/webui/src/utils/misc.ts [new file with mode: 0644]
tools/server/webui/src/utils/storage.ts [new file with mode: 0644]
tools/server/webui/src/utils/types.ts [new file with mode: 0644]
tools/server/webui/src/vite-env.d.ts [new file with mode: 0644]
tools/server/webui/tailwind.config.js [new file with mode: 0644]
tools/server/webui/tsconfig.app.json [new file with mode: 0644]
tools/server/webui/tsconfig.json [new file with mode: 0644]
tools/server/webui/tsconfig.node.json [new file with mode: 0644]
tools/server/webui/vite.config.ts [new file with mode: 0644]
tools/tokenize/CMakeLists.txt [new file with mode: 0644]
tools/tokenize/tokenize.cpp [new file with mode: 0644]
tools/tts/CMakeLists.txt [new file with mode: 0644]
tools/tts/README.md [new file with mode: 0644]
tools/tts/convert_pt_to_hf.py [new file with mode: 0644]
tools/tts/tts-outetts.py [new file with mode: 0644]
tools/tts/tts.cpp [new file with mode: 0644]