]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
sampling: add Top-nσ sampler (#11223)
authorVinesh Janarthanan <redacted>
Thu, 13 Feb 2025 06:45:57 +0000 (00:45 -0600)
committerGitHub <redacted>
Thu, 13 Feb 2025 06:45:57 +0000 (08:45 +0200)
commit27e8a23300e30cd6ff6107ce262acf832ca60597
tree14cf9700b31000877abd2f47260d6736aa6fceb8
parente4376270d971cff7992bdb6c5412a739195b1459
sampling: add Top-nσ sampler (#11223)

* initial sampling changes:

* completed top nsigma sampler implementation

* apply parameter to only llama-cli

* updated readme

* added tests and fixed nsigma impl

* cleaned up pr

* format

* format

* format

* removed commented tests

* cleanup pr and remove explicit floats

* added top-k sampler to improve performance

* changed sigma to float

* fixed string format to float

* Update src/llama-sampling.cpp

Co-authored-by: Georgi Gerganov <redacted>
* Update common/sampling.cpp

Co-authored-by: Georgi Gerganov <redacted>
* Update src/llama-sampling.cpp

Co-authored-by: Georgi Gerganov <redacted>
* Update src/llama-sampling.cpp

Co-authored-by: Georgi Gerganov <redacted>
* Update src/llama-sampling.cpp

Co-authored-by: Georgi Gerganov <redacted>
* Update src/llama-sampling.cpp

Co-authored-by: Georgi Gerganov <redacted>
* added llama_sampler_init

---------

Co-authored-by: Georgi Gerganov <redacted>
common/arg.cpp
common/common.h
common/sampling.cpp
examples/main/README.md
include/llama.h
src/llama-sampling.cpp
tests/test-sampling.cpp