]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
whisper : use ggml_backend_sched (whisper/2239)
authorGeorgi Gerganov <redacted>
Tue, 18 Jun 2024 06:37:20 +0000 (09:37 +0300)
committerGeorgi Gerganov <redacted>
Tue, 18 Jun 2024 06:45:55 +0000 (09:45 +0300)
commit1c266151b44c61120194e79e0cfb678c88c8819a
treeb9613b3d3c8f2df2c0a9e37ba09d9225cc53d6b6
parent7bc1d8e074c2f65ec4f7c92f48ea33675a5cbf44
whisper : use ggml_backend_sched (whisper/2239)

* whisper : use ggml_backend_sched (wip)

* use sched in whisper_allocr

* whisper : single backend in whisper_context

* whisper : remove whisper_state->backends_used

* whisper : remove whisper_context->backend

* whisper : reset scheduler after init

* whisper : fix external encoder (e.g. CoreML)

* whisper : cleanup

* whisper : handle null GPU buffer types + fix sycl

---------

Co-authored-by: slaren <redacted>
include/ggml/ggml-backend.h
src/ggml-backend.c