]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
ggml-cpu: Add CPU backend support for KleidiAI library (#11390)
authorCharles Xu <redacted>
Thu, 20 Feb 2025 13:06:51 +0000 (14:06 +0100)
committerGitHub <redacted>
Thu, 20 Feb 2025 13:06:51 +0000 (15:06 +0200)
commitc5d91a74006c49376590ef2b67420bc7ce206397
treecaa29b05787c042055575290f35f92abc7772d69
parent4806498bf15ef767de3776b00856e56c373dd1b1
ggml-cpu: Add CPU backend support for KleidiAI library (#11390)

* ggml-cpu: Add CPU backend support for KleidiAI library

* Add environmental variable GGML_KLEIDIAI_SME

* Add support for multithread LHS conversion

* Switch kernel selection order to dotprod and i8mm

* updates for review comments

* More updates for review comments

* Reorganize and rename KleidiAI files

* Move ggml-cpu-traits.h to source file

* Update cmake for SME build and add alignment for SME

* Remove append GGML_USE_CPU_KLEIDIAI to the GGML_CDEF_PUBLIC list
ggml/CMakeLists.txt
ggml/include/ggml-cpu.h
ggml/src/ggml-cpu/CMakeLists.txt
ggml/src/ggml-cpu/ggml-cpu.c
ggml/src/ggml-cpu/ggml-cpu.cpp
ggml/src/ggml-cpu/kleidiai/kernels.cpp [new file with mode: 0644]
ggml/src/ggml-cpu/kleidiai/kernels.h [new file with mode: 0644]
ggml/src/ggml-cpu/kleidiai/kleidiai.cpp [new file with mode: 0644]
ggml/src/ggml-cpu/kleidiai/kleidiai.h [new file with mode: 0644]