commit
5fb5e24811cb01d48b482c15a974bfbd9f433e1d (llama : minor
sampling refactor (2) (#9386)) moved the llama_sampler_accept call
into llama_sampler_sample, but the sampling sample usage in llama.h
was forgotten to be updated accordingly.
// // sample from the logits of the last token in the batch
// const llama_token id = llama_sampler_sample(smpl, ctx, -1);
//
- // // accepting the token updates the internal state of certain samplers (e.g. grammar, repetition, etc.)
- // llama_sampler_accept(smpl, id);
// ...
// }
//