]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
SYCL : SOFTMAX F16 mask support and other fixes (#11261)
authorAkarshan Biswas <redacted>
Tue, 28 Jan 2025 09:56:58 +0000 (15:26 +0530)
committerGitHub <redacted>
Tue, 28 Jan 2025 09:56:58 +0000 (09:56 +0000)
commit6e84b0ab8e10b8f6f99a32855f976ebcd35b0353
treeca9edfbff00a5082d6c41956b722406a884f5cdb
parent2b8525d5c89b124c4578a2621cbeb64354ff3d9c
SYCL : SOFTMAX F16 mask support and other fixes (#11261)

Implemented ggml_sycl_op_soft_max() F16 src1(mask) support for which a pragma deprecation warning was added during #5021.
To do this, had to decouple it from ggml_sycl_op_flatten which always considered src1 to be of fp32 type(many OP functions are dependent on it).

* SYCL: SOFTMAX F16 mask support and other fixes

* test-backend-ops: Add F16 mask test cases
ggml/src/ggml-sycl/ggml-sycl.cpp
ggml/src/ggml-sycl/softmax.cpp
ggml/src/ggml-sycl/softmax.hpp
tests/test-backend-ops.cpp