]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 1aa18ef)
k_quants : add AVX support to dot functions with QK_K as 64 (#2339)
authorkatsu560 <redacted>
Tue, 25 Jul 2023 12:13:41 +0000 (21:13 +0900)
committerGitHub <redacted>
Tue, 25 Jul 2023 12:13:41 +0000 (15:13 +0300)
commitbe2301bcdaf6c9f0921141bd071de7788e2a351a
tree2a9d74bc8a272029f917ce8ec8c0adfe3a42895etree
parent1aa18ef994a6a2b531434eb13251ef48e56d345bcommit | diff
k_quants : add AVX support to dot functions with QK_K as 64 (#2339)

* add AVX to ggml_vec_dot_q2_K_q8_K()

* add AVX to ggml_vec_dot_q3_K_q8_K()

* add AVX to ggml_vec_dot_q4_K_q8_K()

* add AVX to ggml_vec_dot_q5_K_q8_K()

* add AVX to ggml_vec_dot_q6_K_q8_K()

* refactor AVX code in ggml_vec_dot_q6_K_q8_K()
k_quants.c diff | blob | history
Packaging of ggml-org/llama.cpp