]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 19d900a)
llama : fix empty batch causing llama_batch_allocr to crash (#9966)
authorXuan Son Nguyen <redacted>
Tue, 22 Oct 2024 14:59:02 +0000 (16:59 +0200)
committerGitHub <redacted>
Tue, 22 Oct 2024 14:59:02 +0000 (16:59 +0200)
commitc8c07d658a6cefc5a50cfdf6be7d726503612303
tree75b703698fa5d6a6b9cf2a542384dae83dc291c3tree
parent19d900a7565b8f6b0a708836a57d26966cb9efe2commit | diff
llama : fix empty batch causing llama_batch_allocr to crash (#9966)

* llama : fix empty batch cause llama_batch_allocr to crash

* move batch_allocr inside decode/encode_internal

* fix build

* add GGML_ASSERT

* Apply suggestions from code review

Co-authored-by: Georgi Gerganov <redacted>
---------

Co-authored-by: Georgi Gerganov <redacted>
src/llama.cpp diff | blob | history
Packaging of ggml-org/llama.cpp