]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 0e07e6a)
perplexity : add support for batch size to `--perplexity` (#407)
authorGary Linscott <redacted>
Thu, 13 Apr 2023 21:50:42 +0000 (14:50 -0700)
committerGitHub <redacted>
Thu, 13 Apr 2023 21:50:42 +0000 (00:50 +0300)
commitbe87b6ed20a5f7528bf491a83e759a9fc6a24fea
tree9f128e67323f6cdf947d5a00c17e2ea19fcd0378tree
parent0e07e6a8399fd993739a3ba3c6f95f92bfab6f58commit | diff
perplexity : add support for batch size to `--perplexity` (#407)

* Add support to batch size for perplexity

* Revert "Fix memory allocation issues and seg faults"

This reverts commit 4870e455b3653f7d7769fa5772b2c90ffad088df.

* update from merge

* Remove perplexity from main

* updates

* Update batch size for efficiency
examples/perplexity/perplexity.cpp diff | blob | history
Packaging of ggml-org/llama.cpp