]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acceleration (llama...
authorZhiyuan Li <redacted>
Thu, 7 Nov 2024 07:19:10 +0000 (18:19 +1100)
committerGeorgi Gerganov <redacted>
Fri, 15 Nov 2024 13:21:04 +0000 (15:21 +0200)
commit42398f13b084484b2bc530a03762078df9923064
treef506f1df3d86f350af5ee6214fb9c75dc7a09f20
parent31c3482a4ea8b63c9f7a165f1f960d3023c17cb6
Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acceleration (llama/10133)

* rwkv6: rename to wkv6

* rwkv6: support avx2 avx512 armv8 armv9

* rwkv6: update cuda file name

* rwkv6: rename params

* wkv on sycl

* sycl: add some ops

* sycl: Enhance OP support judgment

* wkv6: drop armv9 and tranfer to GGML style

ggml-ci

* sync : ggml

* update the function to use appropriate types

* fix define error

* Update ggml/src/ggml-cpu.c

* add appropriate asserts

* move element-wise functions outside

* put the declaration outside the loop

* rewrite to be more inline with the common pattern for distributing threads

* use recommended way GGML_TENSOR_LOCALS

---------

Co-authored-by: Georgi Gerganov <redacted>
Co-authored-by: Diego Devesa <redacted>
Co-authored-by: Plamen Minev <redacted>
Co-authored-by: Yuri Khrustalev <redacted>
Co-authored-by: Meng, Hengyu <redacted>
18 files changed:
ggml/include/ggml.h
ggml/src/ggml-cpu.c
ggml/src/ggml-cuda.cu
ggml/src/ggml-cuda/wkv6.cu [new file with mode: 0644]
ggml/src/ggml-cuda/wkv6.cuh [new file with mode: 0644]
ggml/src/ggml-sycl.cpp
ggml/src/ggml-sycl/backend.hpp
ggml/src/ggml-sycl/common.cpp
ggml/src/ggml-sycl/common.hpp
ggml/src/ggml-sycl/concat.cpp
ggml/src/ggml-sycl/element_wise.cpp [new file with mode: 0644]
ggml/src/ggml-sycl/element_wise.hpp [new file with mode: 0644]
ggml/src/ggml-sycl/outprod.cpp [new file with mode: 0644]
ggml/src/ggml-sycl/outprod.hpp [new file with mode: 0644]
ggml/src/ggml-sycl/presets.hpp
ggml/src/ggml-sycl/wkv6.cpp [new file with mode: 0644]
ggml/src/ggml-sycl/wkv6.hpp [new file with mode: 0644]
ggml/src/ggml.c