]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
convert.py : BPE fixes (#2938)
authorKerfuffle <redacted>
Sun, 3 Sep 2023 05:52:13 +0000 (23:52 -0600)
committerGitHub <redacted>
Sun, 3 Sep 2023 05:52:13 +0000 (08:52 +0300)
commitcff7b0bf07cb46e1ad4fd199f6bdeb538925c8c4
tree8224b4aaae340a3b9c29dc5ce912f1fc2b7f3b04
parent340af42f09a80e32f4998857b4f0543e41124525
convert.py : BPE fixes (#2938)

* convert.py: BPE fixes?

* Remove unnecessary conditional in addl token error handling
convert.py