]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
SYCL : Move to compile time oneMKL interface backend selection for NVIDIA backend...
authorNicolò Scipione <redacted>
Wed, 4 Dec 2024 01:29:20 +0000 (02:29 +0100)
committerGitHub <redacted>
Wed, 4 Dec 2024 01:29:20 +0000 (09:29 +0800)
commit40c6d79fb52f995f47507fedfeaae2ac05d9b35c
tree47b279bafe8865ef318dfe51f3022de6dbd1ab0e
parent98036d5670f21e9b9a99d5e3dbb3bf7589f5c4e3
SYCL : Move to compile time oneMKL interface backend selection for NVIDIA backend (#10584)

* [SYCL] Move to Compile Time backend selection on oneMKL Interface for NVIDIA backend

Move to compile time selection to backend to avoid latency at run time.
Add it to all mkl gemm calls and only for NVIDIA backend.

Signed-off-by: nscipione <redacted>
* Formatting

* Address PR comments to increase readibility

---------

Signed-off-by: nscipione <redacted>
ggml/src/ggml-sycl/CMakeLists.txt
ggml/src/ggml-sycl/dpct/helper.hpp
ggml/src/ggml-sycl/ggml-sycl.cpp
ggml/src/ggml-sycl/outprod.cpp