]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
Support multiple GPUs (split mode) on SYCL backend (llama/5806)
authorNeo Zhang Jianyu <redacted>
Sat, 2 Mar 2024 11:49:30 +0000 (19:49 +0800)
committerGeorgi Gerganov <redacted>
Mon, 4 Mar 2024 08:40:19 +0000 (10:40 +0200)
commitb066493e39b1335327d19c9106592a10f7ebef18
tree732b5fa1adc978862ef7a978dee7c5f6f1a2a4c8
parent33abc32a38e1327ac43e1701a4e39dbc1bd74c4f
Support multiple GPUs (split mode) on SYCL backend (llama/5806)

* suport multiple cards: split-mode - layer|row

* rm warning

* rebase with master, support tow new OPs, close feature for -sm=row, fix for unit test

* update news

* fix merge error

* update according to review comments
src/ggml-sycl.cpp
src/ggml-sycl.h