]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llama : always sort logits before nucleus sampling (#812)
authorIvan Stepanov <redacted>
Fri, 7 Apr 2023 16:02:12 +0000 (19:02 +0300)
committerGitHub <redacted>
Fri, 7 Apr 2023 16:02:12 +0000 (19:02 +0300)
commit4953e9007f86327aabc8312a7211c18019a3a40e
tree1419caafb0d1ebbdd3f05d36e461e8ce10a2edc5
parentcc9cee8e9e7598bd280295f6264f36d3a9224006
llama : always sort logits before nucleus sampling (#812)

* Always sort logits before nucleus sampling

* remove second normalization

- fix windows build
- remove normalization since std::discrete_distribution does not require it
llama.cpp