]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
sampling : deduplicated code for probability distribution access (#6240)
authorMinsoo Cheong <redacted>
Sun, 24 Mar 2024 08:54:07 +0000 (17:54 +0900)
committerGitHub <redacted>
Sun, 24 Mar 2024 08:54:07 +0000 (10:54 +0200)
commit586e7bc561be88e929a9afca7e67d8ead00c53bd
tree7cf1ce22a8b8ea7d711662947fc698e1718905d3
parentddf65685105a39a57b1e7f80c3aa502a6313af24
sampling : deduplicated code for probability distribution access (#6240)

* sampling: remove duplicated code for probability distribution access

* free original_logits

* fix original_logits allocation

* fixes based on review @cebtenzzre

* change function name to `llama_sampling_prepare`
common/sampling.cpp
common/sampling.h
examples/speculative/speculative.cpp
retrieval [new file with mode: 0755]