]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
llama : support more diverse tokenizers? (#2420)
authoreric8607242 <redacted>
Fri, 28 Jul 2023 18:10:05 +0000 (02:10 +0800)
committerGitHub <redacted>
Fri, 28 Jul 2023 18:10:05 +0000 (21:10 +0300)
commitee1b497c985f61d6ec519c39fcfed78a3c6f1d06
treec98adfd2b7b1ce10d80fa3100194b0b5f3150ad2
parentd73b8d48b45d6e2c0ae9bb8c39623c4024adc275
llama : support more diverse tokenizers? (#2420)

* supporting more diverse tokenizers

* Update llama.cpp

---------

Co-authored-by: Georgi Gerganov <redacted>
llama.cpp