]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
py : make convert-pt-to-ggml.py backwards compatible with older vocab.json tokenizer...
authorAkash Mahajan <redacted>
Sun, 25 Jun 2023 10:50:14 +0000 (03:50 -0700)
committerGitHub <redacted>
Sun, 25 Jun 2023 10:50:14 +0000 (13:50 +0300)
commit3ec7bfffe0cb2931c0ba66a90dc8f37ef8df93d3
tree43b91b4175fe64e90600595ebe56ca6c452fc1e2
parenta7f822ef59e9b6bd92b30446a2c427f48fa9af7e
py : make convert-pt-to-ggml.py backwards compatible with older vocab.json tokenizer files (#1001)

* patch checkpoint convert script to keep compatibility with older hf_transformers whisper tokenizer

* typo fix
models/convert-pt-to-ggml.py