]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 8c58330)
server : update readme about token probs (#4777)
authorBehnam M <redacted>
Tue, 9 Jan 2024 10:02:05 +0000 (05:02 -0500)
committerGitHub <redacted>
Tue, 9 Jan 2024 10:02:05 +0000 (12:02 +0200)
commit128de3585b0f58b1e562733448fc00109f23a95d
tree74a500be284dc8305c002e30cab0397ca39cbe05tree
parent8c5833031857c9e9ada61948bae894ab9c785f86commit | diff
server : update readme about token probs (#4777)

* updated server readme to reflect the gg/server-token-probs-4088 commit

added explanation for the API's completion result which now includes `completion_probabilities`. Also added a JSON schema that shows the type/structure of `completion_probabilities`.

* simplified the `completion_probabilities` JSON schema

It's now easier to understand what the structure of `completion_probabilities` looks like.

* minor : fix trailing whitespace

---------

Co-authored-by: Georgi Gerganov <redacted>
examples/server/README.md diff | blob | history
Packaging of ggml-org/llama.cpp