]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
whisper : use ggml_backend_sched (#2239)
authorGeorgi Gerganov <redacted>
Tue, 18 Jun 2024 06:37:20 +0000 (09:37 +0300)
committerGeorgi Gerganov <redacted>
Tue, 18 Jun 2024 06:39:40 +0000 (09:39 +0300)
commit5d950c4b8de82e7eb1a15dec5f56bc36f67697b4
treef28b2ce9d931e2796d818ad05df0071d2f4bda6a
parent820446e23045b6c9347faf64b40124d36cb45ba9
whisper : use ggml_backend_sched (#2239)

* whisper : use ggml_backend_sched (wip)

* use sched in whisper_allocr

* whisper : single backend in whisper_context

* whisper : remove whisper_state->backends_used

* whisper : remove whisper_context->backend

* whisper : reset scheduler after init

* whisper : fix external encoder (e.g. CoreML)

* whisper : cleanup

* whisper : handle null GPU buffer types + fix sycl

---------

Co-authored-by: slaren <redacted>
ggml-backend.c
ggml-backend.h
whisper.cpp