]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 9d85ef3)
ggml : AVX2 support for Q4_0_8_8 (llama/8713)
authorSrihari-mcw <redacted>
Wed, 4 Sep 2024 16:51:22 +0000 (22:21 +0530)
committerGeorgi Gerganov <redacted>
Sun, 8 Sep 2024 11:43:07 +0000 (14:43 +0300)
commitb7b2f64afb66ea8e8858a93d1c4be511b86aba1f
treeb1e720ddd08644e3a05387fd924ab5851972f242tree
parent9d85ef33fa04a3a41ecd73916580da71a30be4f4commit | diff
ggml : AVX2 support for Q4_0_8_8 (llama/8713)

* Add AVX2 based implementations for quantize_q8_0_4x8, ggml_gemv_q4_0_8x8_q8_0 and ggml_gemm_q4_0_8x8_q8_0 functions

* Update code to fix issues occuring due to non alignment of elements to be processed as multiple of 16 in MSVC

* Update comments and indentation

* Make updates to reduce number of load instructions
src/ggml-aarch64.c diff | blob | history
Packaging of ggml-org/ggml