]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
Add AVX acceleration (#617)
authorperserk <redacted>
Fri, 31 Mar 2023 11:55:44 +0000 (16:55 +0500)
committerGitHub <redacted>
Fri, 31 Mar 2023 11:55:44 +0000 (13:55 +0200)
commit02c5b27e91a6d18cf1043d3a2d8dbc59610ac257
treea815c8334ba4fc34390e20ca9fe99b09af71019c
parentcbef542879962fdc491656cd0c8cadd65a5f1356
Add AVX acceleration (#617)

* ggml : add AVX quantize_row_q4_0()

* ggml : add AVX ggml_vec_dot_q4_0()

* ggml : refactor AVX part of ggml_vec_dot_q4_0()

https://github.com/ggerganov/llama.cpp/pull/617#issuecomment-1489985645
ggml.c