]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server: fix incorrectly reported token probabilities (#7125)
authorJohannes Gäßler <redacted>
Tue, 7 May 2024 21:07:58 +0000 (23:07 +0200)
committerGitHub <redacted>
Tue, 7 May 2024 21:07:58 +0000 (23:07 +0200)
commitaf0a5b616359809ce886ea433acedebb39b12969
treec9da4c284790e7ddd053c1c5f5e3b636581ee07a
parentb6aa6702030320a3d5fbc2508307af0d7c947e40
server: fix incorrectly reported token probabilities (#7125)

* server: normalize token probabilities

* fix temperature == 0.0f
common/sampling.cpp
common/sampling.h
examples/server/README.md
examples/server/server.cpp