]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
sampling : Integrate Top-nσ into main sampling chain (and add it to the server) ...
authoroobabooga <redacted>
Mon, 5 May 2025 20:12:19 +0000 (17:12 -0300)
committerGitHub <redacted>
Mon, 5 May 2025 20:12:19 +0000 (22:12 +0200)
commit233461f8121455f957a47e6a22a77b3bc88277b0
treee8e01ad87e8b7560e61b83b5672ee5aa1aa17387
parentb34c859146630dff136943abc9852ca173a7c9d6
sampling : Integrate Top-nσ into main sampling chain (and add it to the server) (#13264)

* sampling: add Top-nσ sampler to `llama-server` and sampler ordering

* revert: sampler ordering

* revert: VS' crappy auto-formatting

* revert: VS' crappy auto-formatting pt.2

* revert: my crappy eye sight...

* sampling: add XTC to Top-nσ sampler chain

* sampling: add Dyna. Temp. to Top-nσ sampler chain

* sampling: actually remove Top-nσ from sampler(oops)

* Integrate top_n_sigma into main sampler chain

* Define COMMON_SAMPLER_TYPE_TOP_N_SIGMA

* Formatting

* Lint

* Exit early in the sampler if nsigma < 0

---------

Co-authored-by: CasualAutopsy <redacted>
common/common.h
common/sampling.cpp
src/llama-sampling.cpp
tools/server/server.cpp