]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 46088f7)
server: add option to output probabilities for completion (#1962)
authorWangHaoranRobin <redacted>
Sun, 2 Jul 2023 21:38:44 +0000 (05:38 +0800)
committerGitHub <redacted>
Sun, 2 Jul 2023 21:38:44 +0000 (00:38 +0300)
commitd7d2e6a0f0c74f7a570dae384dfff371ac744d2a
treead82a8c9b71b5375936062ca2fc89fc012af10edtree
parent46088f72318981341a2d646f12f6eee6aec06d65commit | diff
server: add option to output probabilities for completion (#1962)

* server: add option to output probabilities for completion
* server: fix issue when handling probability output for incomplete tokens for multibyte character generation
* server: fix llama_sample_top_k order
* examples/common.h: put all bool variables in gpt_params together
examples/common.h diff | blob | history
examples/server/server.cpp diff | blob | history
Packaging of ggml-org/llama.cpp