]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 5aa365d)
grammar : pre-computed pieces + reserve mem + less string copies (#4330)
authorMarcus Dunn <redacted>
Tue, 5 Dec 2023 20:55:12 +0000 (10:55 -1000)
committerGitHub <redacted>
Tue, 5 Dec 2023 20:55:12 +0000 (22:55 +0200)
commit5f6e0c0dff1e7a89331e6b25eca9a9fd71324069
treebb701e1396519dea10f58d13164750a5624d2f02tree
parent5aa365d88fdb8fdd430ef3fc141c7a5fd37c3502commit | diff
grammar : pre-computed pieces + reserve mem + less string copies (#4330)

* reserve space for codepoints

* improvement for the appended 0

* used precomputed token text for grammar sample

* reserve canidates_decoded

* reserve canidates_grammar

* remove candidates_decoded

* Revert "remove candidates_decoded"

This reverts commit 3773328080e6a139ee83198329a13cf4ff61d707.

* changed decode_utf8 to take src by ref
llama.cpp diff | blob | history
Packaging of ggml-org/llama.cpp