]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
tests : add script to benchmark whisper.cpp on LibriSpeech corpus (#2999)
authorFujimoto Seiji <redacted>
Fri, 4 Apr 2025 16:51:26 +0000 (01:51 +0900)
committerGitHub <redacted>
Fri, 4 Apr 2025 16:51:26 +0000 (19:51 +0300)
commit448f3d3b93f2411045fb3192fa4d5ddb21eaba4e
tree46232a7d0c4ff86e3ccd220f77ce1cfe7f4284dc
parente6234cd435eb1299ac405916f4083a62ac044b81
tests : add script to benchmark whisper.cpp on LibriSpeech corpus (#2999)

* tests : add script to benchmark whisper.cpp on LibriSpeech corpus

LibriSpeech is a widely-used benchmark dataset for training and
testing speech recognition models.

This adds a set of scripts to measure the recognition accuracy of
whisper.cpp models, following the common benchmark standards.

Signed-off-by: Fujimoto Seiji <redacted>
* Document how to prepare `whisper-cli` and model files

Feedback from Daniel Bevenius.

This adds a short code example how to prepare the `whisper-cli`
command, to make the initial setup step a little bit clearer.

Signed-off-by: Fujimoto Seiji <redacted>
* tests : Simplify how to set up Python environment

Based on a feedback from Georgi Gerganov.

Instead of setting up a virtual environment in Makefile, let users
set up the Python environment. This is better since users may have
their own preferred workflow/toolkit.

Signed-off-by: Fujimoto Seiji <redacted>
---------

Signed-off-by: Fujimoto Seiji <redacted>
tests/librispeech/.gitignore [new file with mode: 0644]
tests/librispeech/Makefile [new file with mode: 0644]
tests/librispeech/README.md [new file with mode: 0644]
tests/librispeech/eval.mk [new file with mode: 0644]
tests/librispeech/eval.py [new file with mode: 0644]
tests/librispeech/normalizers/LICENSE [new file with mode: 0644]
tests/librispeech/normalizers/__init__.py [new file with mode: 0644]
tests/librispeech/normalizers/basic.py [new file with mode: 0644]
tests/librispeech/normalizers/english.json [new file with mode: 0644]
tests/librispeech/normalizers/english.py [new file with mode: 0644]
tests/librispeech/requirements.txt [new file with mode: 0644]