]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 2b3b999)
winogrande: evaluate log-probs in parallel (#5036)
authorKawrakow <redacted>
Fri, 19 Jan 2024 09:39:11 +0000 (11:39 +0200)
committerGitHub <redacted>
Fri, 19 Jan 2024 09:39:11 +0000 (11:39 +0200)
commit7051aacfac0057fa5fac9ea46c55bffc3892d810
tree6acfe85c661119f38409ba40a069a35d26665c43tree
parent2b3b999cacc7ad1207c32fbdf3479a19c06e1a34commit | diff
winogrande: evaluate log-probs in parallel (#5036)

This is a relatively minor performance tweak resulting in
~10% speedup on my system.

Co-authored-by: Iwan Kawrakow <redacted>
examples/perplexity/perplexity.cpp diff | blob | history
Packaging of ggml-org/llama.cpp