]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
Fix SYCL `im2col` and `convert` Overflow with Large Dims (llama/9052)
authorzhentaoyu <redacted>
Tue, 20 Aug 2024 15:06:51 +0000 (23:06 +0800)
committerGeorgi Gerganov <redacted>
Tue, 27 Aug 2024 19:01:14 +0000 (22:01 +0300)
commitbfaac05e1bd0c9969bcd66c82c87df2af8a3acce
tree24e537369d2cd3efca241f995fc1348337608496
parent9c4a027cc1dd6c11b177ebb549964a4b69029173
Fix SYCL `im2col` and `convert` Overflow with Large Dims (llama/9052)

* sycl: fix im2col overflow and sync with cuda

Signed-off-by: zhentaoyu <redacted>
* sycl: fix convert overflow

Signed-off-by: zhentaoyu <redacted>
* sycl: fix convert and dequantize

Signed-off-by: zhentaoyu <redacted>
* sycl: fix ib in dmmv

Signed-off-by: zhentaoyu <redacted>
* sycl:refine convert

Signed-off-by: zhentaoyu <redacted>
* sycl: move downsample global_range into common

Signed-off-by: zhentaoyu <redacted>
* test: add im2col and convert test cases

Signed-off-by: zhentaoyu <redacted>
* test: make new cases only in sycl

Signed-off-by: zhentaoyu <redacted>
* test: comment new test_cases for only local testing

Signed-off-by: zhentaoyu <redacted>
---------

Signed-off-by: zhentaoyu <redacted>
src/ggml-sycl.cpp
src/ggml-sycl/backend.hpp
src/ggml-sycl/common.cpp
src/ggml-sycl/common.hpp
src/ggml-sycl/convert.cpp
src/ggml-sycl/convert.hpp
src/ggml-sycl/dequantize.hpp
src/ggml-sycl/dmmv.cpp
src/ggml-sycl/im2col.cpp [new file with mode: 0644]
src/ggml-sycl/im2col.hpp [new file with mode: 0644]
tests/test-backend-ops.cpp