]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml-cpu: Add CPU backend support for KleidiAI library (llama/11390)
authorCharles Xu <redacted>
Thu, 20 Feb 2025 13:06:51 +0000 (14:06 +0100)
committerGeorgi Gerganov <redacted>
Thu, 27 Feb 2025 06:55:36 +0000 (08:55 +0200)
commitdc21871fcb26b10529f30bff679be7909513716a
treed1456baf728b2e9ed6eb23c4446fff919eb19e58
parent64a430bc812f793f2f506126bcfda95a4d104498
ggml-cpu: Add CPU backend support for KleidiAI library (llama/11390)

* ggml-cpu: Add CPU backend support for KleidiAI library

* Add environmental variable GGML_KLEIDIAI_SME

* Add support for multithread LHS conversion

* Switch kernel selection order to dotprod and i8mm

* updates for review comments

* More updates for review comments

* Reorganize and rename KleidiAI files

* Move ggml-cpu-traits.h to source file

* Update cmake for SME build and add alignment for SME

* Remove append GGML_USE_CPU_KLEIDIAI to the GGML_CDEF_PUBLIC list
ggml/CMakeLists.txt
ggml/include/ggml-cpu.h
ggml/src/ggml-cpu/CMakeLists.txt
ggml/src/ggml-cpu/ggml-cpu.c
ggml/src/ggml-cpu/ggml-cpu.cpp
ggml/src/ggml-cpu/kleidiai/kernels.cpp [new file with mode: 0644]
ggml/src/ggml-cpu/kleidiai/kernels.h [new file with mode: 0644]
ggml/src/ggml-cpu/kleidiai/kleidiai.cpp [new file with mode: 0644]
ggml/src/ggml-cpu/kleidiai/kleidiai.h [new file with mode: 0644]