]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acceleration (...
authorZhiyuan Li <redacted>
Thu, 7 Nov 2024 07:19:10 +0000 (18:19 +1100)
committerGitHub <redacted>
Thu, 7 Nov 2024 07:19:10 +0000 (15:19 +0800)
commit3bcd40b3c593d14261fb2abfabad3c0fb5b9e318
treebe207f51297029328bb9a5fee6ca2d0c5cfc8cc4
parent5c333e014059122245c318e7ed4ec27d1085573c
Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acceleration (#10133)

* rwkv6: rename to wkv6

* rwkv6: support avx2 avx512 armv8 armv9

* rwkv6: update cuda file name

* rwkv6: rename params

* wkv on sycl

* sycl: add some ops

* sycl: Enhance OP support judgment

* wkv6: drop armv9 and tranfer to GGML style

ggml-ci

* sync : ggml

* update the function to use appropriate types

* fix define error

* Update ggml/src/ggml-cpu.c

* add appropriate asserts

* move element-wise functions outside

* put the declaration outside the loop

* rewrite to be more inline with the common pattern for distributing threads

* use recommended way GGML_TENSOR_LOCALS

---------

Co-authored-by: Georgi Gerganov <redacted>
Co-authored-by: Diego Devesa <redacted>
Co-authored-by: Plamen Minev <redacted>
Co-authored-by: Yuri Khrustalev <redacted>
Co-authored-by: Meng, Hengyu <redacted>
23 files changed:
docs/backend/SYCL.md
ggml/include/ggml.h
ggml/src/ggml-cpu.c
ggml/src/ggml-cuda.cu
ggml/src/ggml-cuda/rwkv-wkv.cu [deleted file]
ggml/src/ggml-cuda/rwkv-wkv.cuh [deleted file]
ggml/src/ggml-cuda/wkv6.cu [new file with mode: 0644]
ggml/src/ggml-cuda/wkv6.cuh [new file with mode: 0644]
ggml/src/ggml-sycl.cpp
ggml/src/ggml-sycl/backend.hpp
ggml/src/ggml-sycl/common.cpp
ggml/src/ggml-sycl/common.hpp
ggml/src/ggml-sycl/concat.cpp
ggml/src/ggml-sycl/element_wise.cpp [new file with mode: 0644]
ggml/src/ggml-sycl/element_wise.hpp [new file with mode: 0644]
ggml/src/ggml-sycl/outprod.cpp [new file with mode: 0644]
ggml/src/ggml-sycl/outprod.hpp [new file with mode: 0644]
ggml/src/ggml-sycl/presets.hpp
ggml/src/ggml-sycl/wkv6.cpp [new file with mode: 0644]
ggml/src/ggml-sycl/wkv6.hpp [new file with mode: 0644]
ggml/src/ggml.c
src/llama.cpp
tests/test-backend-ops.cpp