]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: f99d3f8)
common : ensure llama_batch size does not exceed max size (#9668)
authormatiaslin <redacted>
Sun, 29 Sep 2024 12:25:00 +0000 (05:25 -0700)
committerGitHub <redacted>
Sun, 29 Sep 2024 12:25:00 +0000 (15:25 +0300)
commitfaac0bae265449fd988c57bf894018edc36fbe1e
treee0a564b66d9f36fb53d2e90d69217f73f9cdbe67tree
parentf99d3f8367174f7aba73c07fd87de687d4a0ece1commit | diff
common : ensure llama_batch size does not exceed max size (#9668)

A crash was observed when the number of tokens added to a batch exceeds
llama_batch size. An assertion in llama_batch_add was added to protect
against llama_batch size overflow.
common/common.cpp diff | blob | history
Packaging of ggml-org/llama.cpp