]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 3ab3e65)
Compute perplexity over prompt (#270)
authorGary Linscott <redacted>
Tue, 21 Mar 2023 16:27:42 +0000 (09:27 -0700)
committerGitHub <redacted>
Tue, 21 Mar 2023 16:27:42 +0000 (18:27 +0200)
commit486ae645fd3eda8b9d7413d5ff34fb65a3e337fb
treecf16e8b85548c48a781046d36e3d5b87d802f38atree
parent3ab3e6582f7320c2b6568c892fdfc8215caf7e6ccommit | diff
Compute perplexity over prompt (#270)

* Compute perplexity over prompt

* More accurate perplexity calculation - over all logits in the context window (so 512x more tokens!)

* Output all perplexitiies

* Add timing/ETA
main.cpp diff | blob | history
utils.cpp diff | blob | history
utils.h diff | blob | history
Packaging of ggml-org/llama.cpp