]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 527b6fb)
llama : fix top-p sampling to match the canonical definition (#1953)
authorAlex Renda <redacted>
Sat, 24 Jun 2023 10:15:01 +0000 (03:15 -0700)
committerGitHub <redacted>
Sat, 24 Jun 2023 10:15:01 +0000 (13:15 +0300)
commitb061ba9e2a7a2c335a200df8c11aed5e31e4ccbb
tree0bf01d16d556af5ab9a3990d8859a5ff1f3ea4c0tree
parent527b6fba1d237befb324fd846bda7418c0fa394dcommit | diff
llama : fix top-p sampling to match the canonical definition (#1953)

* Fix top-p sampling to match the standard definition (smallest set that has probability mass at least p, not largest set with probability mass less than p)

* top-p: correct gt to gte

* add test for correct top-p behavior
llama.cpp diff | blob | history
tests/test-sampling.cpp diff | blob | history
Packaging of ggml-org/llama.cpp