]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
SYCL : Move to compile time oneMKL interface backend selection for NVIDIA backend...
authorNicolò Scipione <redacted>
Wed, 4 Dec 2024 01:29:20 +0000 (02:29 +0100)
committerGeorgi Gerganov <redacted>
Thu, 5 Dec 2024 12:27:39 +0000 (14:27 +0200)
commit97f2de079e1d96c4cef6a44a4d4ebfec973d1c97
tree49dd63c64a4a946c37c736f71f68b8c9d88a42b3
parentc91f196f977b2f1b7c23dcde2b9648e46ebe41ce
SYCL : Move to compile time oneMKL interface backend selection for NVIDIA backend (llama/10584)

* [SYCL] Move to Compile Time backend selection on oneMKL Interface for NVIDIA backend

Move to compile time selection to backend to avoid latency at run time.
Add it to all mkl gemm calls and only for NVIDIA backend.

Signed-off-by: nscipione <redacted>
* Formatting

* Address PR comments to increase readibility

---------

Signed-off-by: nscipione <redacted>
src/ggml-sycl/CMakeLists.txt
src/ggml-sycl/dpct/helper.hpp
src/ggml-sycl/ggml-sycl.cpp
src/ggml-sycl/outprod.cpp