]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 098f6d7)
py : handle byte tokens in `get_token_type` (#5341)
authorGeorgi Gerganov <redacted>
Tue, 6 Feb 2024 05:47:22 +0000 (07:47 +0200)
committerGitHub <redacted>
Tue, 6 Feb 2024 05:47:22 +0000 (07:47 +0200)
commit906cff55c2848fda091d888a1585915ec0c9ea9e
treea1229b3104020dac71711b6128ee9df94b16f7e8tree
parent098f6d737b65134cf220d12b9b706e8cfc5e4610commit | diff
py : handle byte tokens in `get_token_type` (#5341)

* py : handle byte tokens in `get_token_type`

* py : fix empty bytes arg
convert.py diff | blob | history
Packaging of ggml-org/llama.cpp