]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
sampler : remove "full-context windows" from history-based samplers (#26524)
authorOliver Simons <redacted>
Tue, 4 Aug 2026 18:28:55 +0000 (20:28 +0200)
committerGitHub <redacted>
Tue, 4 Aug 2026 18:28:55 +0000 (21:28 +0300)
commita6aa6f5450eaad18b3c86631b5c3fff330f5a46e
tree57ce14eb02b3b6d3aeb399383d1db13a6ac059c9
parent76c956c1372962842e1134f86b7c5d4517597e7e
sampler : remove "full-context windows" from history-based samplers (#26524)

* Resolve -1 to 1024 instead of ctx-len for samplers

Because of backend-sampling we initialize samplers before the complete
llama_context is there. Therefore, we cannot infer the resolved context
length yet at the time we construct the samplers.

* Shared default of 64 for history-based samplers, remove context_size
18 files changed:
common/arg.cpp
common/common.cpp
common/common.h
common/sampling.cpp
common/sampling.h
include/llama.h
src/llama-sampler.cpp
src/llama-sampler.h
tests/test-arg-parser.cpp
tests/test-sampling.cpp
tools/cli/README.md
tools/completion/README.md
tools/mtmd/tests/test-deepseek-ocr.py
tools/server/README.md
tools/server/server-context.cpp
tools/server/server-schema.cpp
tools/server/server-schema.h
tools/ui/src/lib/services/parameter-sync.service.spec.ts