]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 4682887)
server : add "tokens" output (#10853)
authorGeorgi Gerganov <redacted>
Wed, 18 Dec 2024 09:05:29 +0000 (11:05 +0200)
committerGitHub <redacted>
Wed, 18 Dec 2024 09:05:29 +0000 (11:05 +0200)
commit0e70ba686e6c717a0aa41d88284e2a392c2bd0cd
tree1d0434c848a47907dfaf803d688378757c166981tree
parent46828872c31b25df16169cbbf5c2225fa9cb0675commit | diff
server : add "tokens" output (#10853)

* server : add "tokens" output

ggml-ci

* server : update readme

ggml-ci

* server : return tokens ids only if requested

ggml-ci

* tests : improve "tokens" type check

Co-authored-by: Xuan Son Nguyen <redacted>
* server : remove "tokens" from the OAI endpoint

ggml-ci

---------

Co-authored-by: Xuan Son Nguyen <redacted>
examples/server/README.md diff | blob | history
examples/server/server.cpp diff | blob | history
examples/server/tests/unit/test_completion.py diff | blob | history
Packaging of ggml-org/llama.cpp