]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
Warn user if a context size greater than 2048 tokens is specified (#274)
authorRonsor <redacted>
Sun, 19 Mar 2023 00:10:47 +0000 (17:10 -0700)
committerGitHub <redacted>
Sun, 19 Mar 2023 00:10:47 +0000 (20:10 -0400)
commitd7def1a7524f712e5ebb7cd02bab0f13aa56a7f9
treeda932c4b380d0f1449aea58bdf3cdf57be56f70c
parent6f61c18ec9a30416e21ed5abfb1321bdb14979be
Warn user if a context size greater than 2048 tokens is specified (#274)

LLaMA doesn't support more than 2048 token context sizes, and going above that produces terrible results.
main.cpp