]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
fix perplexity after c-api refactor (#390)
authorErik Scholz <redacted>
Wed, 22 Mar 2023 16:09:38 +0000 (17:09 +0100)
committerGitHub <redacted>
Wed, 22 Mar 2023 16:09:38 +0000 (18:09 +0200)
commit56e659a0b271436e24813a801640d015e7b05328
tree599b4c53f4f81b5de59f477d331b28bd260fc78d
parent40ea807a972ec7b5a426f034ebfa593b5e7a06ed
fix perplexity after c-api refactor (#390)

* preallocate a buffer of fitting size for tokenization (utils.cpp)

* don't create a new std::string (especially here, where it's usually large)
main.cpp
utils.cpp