]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
whisper : use ggml_backend_sched (whisper/2239)
authorGeorgi Gerganov <redacted>
Tue, 18 Jun 2024 06:37:20 +0000 (09:37 +0300)
committerGeorgi Gerganov <redacted>
Tue, 18 Jun 2024 06:50:40 +0000 (09:50 +0300)
commite6ecc2be470e3c5c6c5c9d8b90aa83a1f7725084
treeb9ef166a2fa1895e59fb34e1bf73cc1b145c85b7
parenta94e6ff8774b7c9f950d9545baf0ce35e8d1ed2f
whisper : use ggml_backend_sched (whisper/2239)

* whisper : use ggml_backend_sched (wip)

* use sched in whisper_allocr

* whisper : single backend in whisper_context

* whisper : remove whisper_state->backends_used

* whisper : remove whisper_context->backend

* whisper : reset scheduler after init

* whisper : fix external encoder (e.g. CoreML)

* whisper : cleanup

* whisper : handle null GPU buffer types + fix sycl

---------

Co-authored-by: slaren <redacted>
ggml-backend.c
ggml-backend.h