]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
whisper : tokenizer fix + re-enable tokenizer test for LLaMa (#3096)
authorgoerch <redacted>
Wed, 13 Sep 2023 13:19:44 +0000 (15:19 +0200)
committerGitHub <redacted>
Wed, 13 Sep 2023 13:19:44 +0000 (16:19 +0300)
commit71ca2fad7d6c0ef95ef9944fb3a1a843e481f314
tree21bc810807b527d5892e8184d5f1dae0b184e923
parent1b6c650d16048d6427dd502a9627e72837265844
whisper : tokenizer fix + re-enable tokenizer test for LLaMa (#3096)

* Fix für #2721

* Reenable tokenizer test for LLaMa

* Add `console.cpp` dependency

* Fix dependency to `common`

* Fixing wrong fix.

* Make console usage platform specific

Work on compiler warnings.

* Adapting makefile

* Remove trailing whitespace

* Adapting the other parts of the makefile

* Fix typo.
Makefile
llama.cpp
tests/CMakeLists.txt
tests/test-tokenizer-0-llama.cpp
tests/test-tokenizer-1-llama.cpp [new file with mode: 0644]
tests/test-tokenizer-1.cpp [deleted file]