]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 27d135c)
Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunc...
authorOlivier Chafik <redacted>
Thu, 30 Jan 2025 19:13:58 +0000 (19:13 +0000)
committerGitHub <redacted>
Thu, 30 Jan 2025 19:13:58 +0000 (19:13 +0000)
commit8b576b6c55bc4e6be898b47522f0ef402b93ef62
treef8afb2fa71ef1d388eab0b6db64b908e91148af5tree
parent27d135c970c00f655d486f870edacded792bef5ccommit | diff
Tool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639)

---------

Co-authored-by: Xuan Son Nguyen <redacted>
Co-authored-by: Georgi Gerganov <redacted>
Co-authored-by: Xuan Son Nguyen <redacted>
49 files changed:
.editorconfig diff | blob | history
.github/workflows/server.yml diff | blob | history
Makefile diff | blob | history
README.md diff | blob | history
common/CMakeLists.txt diff | blob | history
common/chat.cpp [new file with mode: 0644] blob
common/chat.hpp [new file with mode: 0644] blob
common/common.cpp diff | blob | history
common/common.h diff | blob | history
common/json-schema-to-grammar.cpp diff | blob | history
common/json-schema-to-grammar.h diff | blob | history
common/sampling.cpp diff | blob | history
examples/gbnf-validator/gbnf-validator.cpp diff | blob | history
examples/main/main.cpp diff | blob | history
examples/server/README.md diff | blob | history
examples/server/server.cpp diff | blob | history
examples/server/tests/README.md diff | blob | history
examples/server/tests/pytest.ini [new file with mode: 0644] blob
examples/server/tests/tests.sh diff | blob | history
examples/server/tests/unit/test_chat_completion.py diff | blob | history
examples/server/tests/unit/test_tool_call.py [new file with mode: 0644] blob
examples/server/tests/utils.py diff | blob | history
examples/server/utils.hpp diff | blob | history
include/llama.h diff | blob | history
models/templates/CohereForAI-c4ai-command-r-plus-tool_use.jinja [new file with mode: 0644] blob
models/templates/NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja [new file with mode: 0644] blob
models/templates/NousResearch-Hermes-3-Llama-3.1-8B-tool_use.jinja [new file with mode: 0644] blob
models/templates/Qwen-Qwen2.5-7B-Instruct.jinja [new file with mode: 0644] blob
models/templates/deepseek-ai-DeepSeek-R1-Distill-Llama-8B.jinja [new file with mode: 0644] blob
models/templates/deepseek-ai-DeepSeek-R1-Distill-Qwen-32B.jinja [new file with mode: 0644] blob
models/templates/fireworks-ai-llama-3-firefunction-v2.jinja [new file with mode: 0644] blob
models/templates/google-gemma-2-2b-it.jinja [new file with mode: 0644] blob
models/templates/meetkai-functionary-medium-v3.1.jinja [new file with mode: 0644] blob
models/templates/meetkai-functionary-medium-v3.2.jinja [new file with mode: 0644] blob
models/templates/meta-llama-Llama-3.1-8B-Instruct.jinja [new file with mode: 0644] blob
models/templates/meta-llama-Llama-3.2-3B-Instruct.jinja [new file with mode: 0644] blob
models/templates/meta-llama-Llama-3.3-70B-Instruct.jinja [new file with mode: 0644] blob
models/templates/microsoft-Phi-3.5-mini-instruct.jinja [new file with mode: 0644] blob
models/templates/mistralai-Mistral-Nemo-Instruct-2407.jinja [new file with mode: 0644] blob
scripts/fetch_server_test_models.py [new file with mode: 0755] blob
scripts/get_chat_template.py [new file with mode: 0644] blob
scripts/get_hf_chat_template.py [deleted file] blob | history
src/llama-grammar.cpp diff | blob | history
src/llama-grammar.h diff | blob | history
src/llama-sampling.cpp diff | blob | history
tests/CMakeLists.txt diff | blob | history
tests/test-chat-template.cpp diff | blob | history
tests/test-chat.cpp [new file with mode: 0644] blob
tests/test-grammar-integration.cpp diff | blob | history
Packaging of ggml-org/llama.cpp