]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
overview / pkg / ggml / sources / whisper.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 164f13c)
ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (llama/11227)
authorfj-y-saito <redacted>
Thu, 16 Jan 2025 09:11:49 +0000 (18:11 +0900)
committerGeorgi Gerganov <redacted>
Mon, 3 Feb 2025 20:00:57 +0000 (22:00 +0200)
commitdb6383094c347474c3af1fddc83cc386177cfbd5
tree50f0f2eda70b7e4d520744b3a6ef57ae4c06f0e0tree
parent164f13c6a9054c704682dbcfb10c37718863e660commit | diff
ggml: aarch64: implement SVE kernels for q4_K_q8_K vector dot (llama/11227)

* Add SVE support for q4_K_q8_K

* Update ggml/src/ggml-cpu/ggml-cpu-quants.c

change to use K_SCALE_SIZE

Co-authored-by: Georgi Gerganov <redacted>
---------

Co-authored-by: Georgi Gerganov <redacted>
ggml/src/ggml-cpu/ggml-cpu-quants.c diff | blob | history
Packaging of ggerganov/whisper.cpp