]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commitdiff
spec : reset i_last when low acceptance streak occurs (#22168)
authorPaul Dubs <redacted>
Tue, 21 Apr 2026 18:29:07 +0000 (20:29 +0200)
committerGitHub <redacted>
Tue, 21 Apr 2026 18:29:07 +0000 (21:29 +0300)
By resetting i_last to zero, we will include the current context when rebuilding the speculative map.

common/speculative.cpp

index daa2b5a8ac9a22ac4dd0f0311de80125315deed0..20e38bec46ceda4b72088278648b1242cd58e9b9 100644 (file)
@@ -749,6 +749,7 @@ struct common_speculative_state_ngram_mod : public common_speculative_state {
 
                     mod.reset();
                     n_low = 0;
+                    i_last = 0;
                 }
             } else {
                 n_low = 0;