]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server : add Anthropic Messages API support (#17570)
authorFredrik Hultin <redacted>
Fri, 28 Nov 2025 11:57:04 +0000 (12:57 +0100)
committerGitHub <redacted>
Fri, 28 Nov 2025 11:57:04 +0000 (12:57 +0100)
commitddf9f94389a614ce005347f1c3f60ce477df1be1
tree320db84206bd0d0626a09b0c1ca365822e7754f1
parentff55414c42522adbeaa1bd9c52c0e9db16942484
server : add Anthropic Messages API support (#17570)

* server : add Anthropic Messages API support

* remove -@pytest.mark.slow from tool calling/jinja tests

* server : remove unused code and slow/skip on test_anthropic_vision_base64_with_multimodal_model in test_anthropic_api.py

* server : removed redundant n field logic in anthropic_params_from_json

* server : use single error object instead of error_array in streaming response handler for /v1/chat/completions and use unordered_set instead of set in to_json_anthropic_stream()

* server : refactor Anthropic API to use OAI conversion

* make sure basic test always go first

* clean up

* clean up api key check, add test

---------

Co-authored-by: Xuan Son Nguyen <redacted>
tools/server/README.md
tools/server/server-common.cpp
tools/server/server-common.h
tools/server/server-http.cpp
tools/server/server-task.cpp
tools/server/server-task.h
tools/server/server.cpp
tools/server/tests/conftest.py
tools/server/tests/unit/test_basic.py
tools/server/tests/unit/test_compat_anthropic.py [new file with mode: 0644]
tools/server/tests/unit/test_security.py