]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
whisper : add OpenVINO support (#1037)
authorRyan Metcalfe <redacted>
Tue, 4 Jul 2023 12:56:11 +0000 (08:56 -0400)
committerGitHub <redacted>
Tue, 4 Jul 2023 12:56:11 +0000 (15:56 +0300)
commit62b81276e02f48070c3fd1e265e319f3604bfb39
treeb6e42af522398421a374b742ec3de57320d16f18
parent176d7e4e7b7aa03e7c5303f8654cdc7cecf36e8e
whisper : add OpenVINO support (#1037)

* openvino: use OpenVINO encoder inference

* openvino: add python script for OpenVINO model generation

* whisper: Fix 'unused' warnings when OpenVINO isn't enabled in build

* Apply suggestions from code review

Co-authored-by: Georgi Gerganov <redacted>
* whisper: Fix compilation error

* whisper: revert whisper_get_openvino_path_encoder & whisper_get_openvino_path_cache to non-const func signatures

* cmake: Add openvino-encoder as separate object target

* whisper : minor style fixes

* minor : indentation fixes

---------

Co-authored-by: Georgi Gerganov <redacted>
CMakeLists.txt
examples/main/main.cpp
models/convert-whisper-to-openvino.py [new file with mode: 0644]
models/openvino-conversion-requirements.txt [new file with mode: 0644]
openvino/whisper-openvino-encoder.cpp [new file with mode: 0644]
openvino/whisper-openvino-encoder.h [new file with mode: 0644]
whisper.cpp
whisper.h