]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841)
authorkalomaze <redacted>
Tue, 31 Oct 2023 19:44:49 +0000 (14:44 -0500)
committerGitHub <redacted>
Tue, 31 Oct 2023 19:44:49 +0000 (20:44 +0100)
commit238657db2364cfb728c694470a4a81702afea760
tree8b870a0600d1a2de4d9efe7981c24164357f5552
parent07178c98e1b61a5e2af39d347add12e7eb9e08e1
samplers : Min-P sampler implementation [alternative to Top P/Top K] (#3841)

* Introduce the new Min-P sampler by @kalomaze
   The Min-P sampling method was designed as an alternative to Top-P, and aims to ensure a balance of quality and variety. The parameter *p* represents the minimum probability for a token to be considered, relative to the probability of the most likely token.

* Min-P enabled and set to 0.05 default

---------

Co-authored-by: Georgi Gerganov <redacted>
Co-authored-by: cebtenzzre <redacted>
common/common.cpp
common/sampling.cpp
common/sampling.h
examples/main/README.md
llama.cpp
llama.h