git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit

author	zhentaoyu <redacted>
	Tue, 20 Aug 2024 15:06:51 +0000 (23:06 +0800)
committer	Georgi Gerganov <redacted>
	Wed, 28 Aug 2024 10:22:20 +0000 (13:22 +0300)
commit	58b725282acd3af5c29eb42628f982e5a179d42f
tree	185e1934fd1f8600a97ee414b0624b19d09a37e1	tree
parent	7e59afa1e01fcd08b6272245b9042c1fb9a2bfcc	commit \| diff

Fix SYCL `im2col` and `convert` Overflow with Large Dims (llama/9052)

* sycl: fix im2col overflow and sync with cuda

Signed-off-by: zhentaoyu <redacted>
* sycl: fix convert overflow

Signed-off-by: zhentaoyu <redacted>
* sycl: fix convert and dequantize

Signed-off-by: zhentaoyu <redacted>
* sycl: fix ib in dmmv

Signed-off-by: zhentaoyu <redacted>
* sycl:refine convert

Signed-off-by: zhentaoyu <redacted>
* sycl: move downsample global_range into common

Signed-off-by: zhentaoyu <redacted>
* test: add im2col and convert test cases

Signed-off-by: zhentaoyu <redacted>
* test: make new cases only in sycl

Signed-off-by: zhentaoyu <redacted>
* test: comment new test_cases for only local testing

Signed-off-by: zhentaoyu <redacted>
---------

Signed-off-by: zhentaoyu <redacted>

ggml/src/ggml-sycl.cpp		diff \| blob \| history
ggml/src/ggml-sycl/backend.hpp		diff \| blob \| history
ggml/src/ggml-sycl/common.cpp		diff \| blob \| history
ggml/src/ggml-sycl/common.hpp		diff \| blob \| history
ggml/src/ggml-sycl/convert.cpp		diff \| blob \| history
ggml/src/ggml-sycl/convert.hpp		diff \| blob \| history
ggml/src/ggml-sycl/dequantize.hpp		diff \| blob \| history
ggml/src/ggml-sycl/dmmv.cpp		diff \| blob \| history
ggml/src/ggml-sycl/im2col.cpp	[new file with mode: 0644]	blob
ggml/src/ggml-sycl/im2col.hpp	[new file with mode: 0644]	blob