]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 1774611)
llama : add option for greedy sampling with probs (#3813)
authorGeorgi Gerganov <redacted>
Sat, 28 Oct 2023 11:23:11 +0000 (14:23 +0300)
committerGitHub <redacted>
Sat, 28 Oct 2023 11:23:11 +0000 (14:23 +0300)
commitee1a0ec9cb367ba41d138134795cbbbe93d2bf1c
tree04111cbd66f34c6cc986e70bb47b96b39828e0f2tree
parent177461104b454163473dced2a5038f4e016cdb7ecommit | diff
llama : add option for greedy sampling with probs (#3813)

* llama : add option for greedy sampling with probs

* llama : add comment about llama_sample_token_greedy() missing probs

* sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs
common/common.cpp diff | blob | history
common/sampling.cpp diff | blob | history
examples/speculative/speculative.cpp diff | blob | history
llama.h diff | blob | history
Packaging of ggml-org/llama.cpp