]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
[SYCL] Fix the sub group size of Intel (#8106)
authorluoyu-intel <redacted>
Tue, 2 Jul 2024 02:16:00 +0000 (02:16 +0000)
committerGitHub <redacted>
Tue, 2 Jul 2024 02:16:00 +0000 (10:16 +0800)
commitd08c20eddedb24515a3212e2de66bdff41a26b8c
tree7beffefbefab54f6a84f921222456666cefb2070
parent5fac350b9cc49d0446fc291b9c4ad53666c77591
[SYCL] Fix the sub group size of Intel (#8106)

* use warp_size macro for all sycl kernels

* fix mask of permute_sub_group_by_xor

* fix rms_norm with correct warp number

* fix rms_norm_f32/group_norm_f32

* move norm to norm.cpp file

* fix quantize bug

* fix mmvq's batch size
ggml/src/CMakeLists.txt
ggml/src/ggml-sycl.cpp
ggml/src/ggml-sycl/backend.hpp
ggml/src/ggml-sycl/common.hpp
ggml/src/ggml-sycl/dmmv.cpp
ggml/src/ggml-sycl/mmvq.cpp
ggml/src/ggml-sycl/norm.cpp [new file with mode: 0644]
ggml/src/ggml-sycl/norm.hpp [new file with mode: 0644]
ggml/src/ggml-sycl/presets.hpp