]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 996b426)
ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (llama/11227)
authorfj-y-saito <redacted>
Thu, 16 Jan 2025 09:11:49 +0000 (18:11 +0900)
committerGeorgi Gerganov <redacted>
Wed, 29 Jan 2025 10:57:00 +0000 (12:57 +0200)
commit4d227d4d915c55c3b8f796611591e86455d9879d
tree70480b08aae03f703dba3825e3067e0a8a990192tree
parent996b4269fedb58a3ec7057fea35260e049e61ef3commit | diff
ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (llama/11227)

* Add SVE support for q4_K_q8_K

* Update ggml/src/ggml-cpu/ggml-cpu-quants.c

change to use K_SCALE_SIZE

Co-authored-by: Georgi Gerganov <redacted>
---------

Co-authored-by: Georgi Gerganov <redacted>
src/ggml-cpu/ggml-cpu-quants.c diff | blob | history
Packaging of ggml-org/ggml