]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
ggml-cpu: Add CPU backend support for KleidiAI library (llama/11390)
authorCharles Xu <redacted>
Thu, 20 Feb 2025 13:06:51 +0000 (14:06 +0100)
committerGeorgi Gerganov <redacted>
Tue, 25 Feb 2025 11:33:09 +0000 (13:33 +0200)
commitfa8c7815e3796bf8cdc34028d681b2b4b636d93c
treec5170ae6031d2323696605650f849599f8bb1c40
parentd4dd5df2adce9afde199711ae026a96282f78044
ggml-cpu: Add CPU backend support for KleidiAI library (llama/11390)

* ggml-cpu: Add CPU backend support for KleidiAI library

* Add environmental variable GGML_KLEIDIAI_SME

* Add support for multithread LHS conversion

* Switch kernel selection order to dotprod and i8mm

* updates for review comments

* More updates for review comments

* Reorganize and rename KleidiAI files

* Move ggml-cpu-traits.h to source file

* Update cmake for SME build and add alignment for SME

* Remove append GGML_USE_CPU_KLEIDIAI to the GGML_CDEF_PUBLIC list
CMakeLists.txt
include/ggml-cpu.h
src/ggml-cpu/CMakeLists.txt
src/ggml-cpu/ggml-cpu.c
src/ggml-cpu/ggml-cpu.cpp
src/ggml-cpu/kleidiai/kernels.cpp [new file with mode: 0644]
src/ggml-cpu/kleidiai/kernels.h [new file with mode: 0644]
src/ggml-cpu/kleidiai/kleidiai.cpp [new file with mode: 0644]
src/ggml-cpu/kleidiai/kleidiai.h [new file with mode: 0644]