]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: e536426)
llama : sanitize invalid tokens (#9357)
authorGeorgi Gerganov <redacted>
Sat, 7 Sep 2024 21:33:13 +0000 (00:33 +0300)
committerGitHub <redacted>
Sat, 7 Sep 2024 21:33:13 +0000 (00:33 +0300)
commitfaf69d4237c9ae4d7f572b4674d1002463e8acd3
tree3b9569438e7cbdcbb1f1c9f9cb63b5a26cbde3dbtree
parente536426ded3fb4a8cd13626e53508cd92928d6c2commit | diff
llama : sanitize invalid tokens (#9357)

* common : do not add null tokens during warmup

ggml-ci

* llama : check that the input tokens are valid

ggml-ci

* tests : fix batch size of bert model

ggml-ci
common/common.cpp diff | blob | history
examples/server/tests/features/embeddings.feature diff | blob | history
src/llama.cpp diff | blob | history
Packaging of ggml-org/llama.cpp