]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
SYCL : Move to compile time oneMKL interface backend selection for NVIDIA backend...
authorNicolò Scipione <redacted>
Wed, 4 Dec 2024 01:29:20 +0000 (02:29 +0100)
committerGeorgi Gerganov <redacted>
Sun, 8 Dec 2024 18:14:35 +0000 (20:14 +0200)
commit966433fdf2184d7530daa120132415c95e1fdccb
treedf93bf0c71dc07a4c71438a0d3fecb533505ffd0
parent6f1ba9d82d3ae0a6d012152f344896805a1ffefa
SYCL : Move to compile time oneMKL interface backend selection for NVIDIA backend (llama/10584)

* [SYCL] Move to Compile Time backend selection on oneMKL Interface for NVIDIA backend

Move to compile time selection to backend to avoid latency at run time.
Add it to all mkl gemm calls and only for NVIDIA backend.

Signed-off-by: nscipione <redacted>
* Formatting

* Address PR comments to increase readibility

---------

Signed-off-by: nscipione <redacted>
ggml/src/ggml-sycl/CMakeLists.txt
ggml/src/ggml-sycl/dpct/helper.hpp
ggml/src/ggml-sycl/ggml-sycl.cpp
ggml/src/ggml-sycl/outprod.cpp