]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
overview / pkg / ggml / sources / ggml / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: f7b4084)
Faster AVX2 dot product for IQ2_XS (llama/5187)
authorKawrakow <redacted>
Tue, 30 Jan 2024 13:15:07 +0000 (15:15 +0200)
committerGeorgi Gerganov <redacted>
Tue, 30 Jan 2024 19:21:10 +0000 (21:21 +0200)
commit9ea07694acad9fe1f0d126f91febae045b772d87
tree6cab90be12519e3e9a40b0957796e834eecd12d8tree
parentf7b408495c144a682fe07cce75d10a394811aececommit | diff
Faster AVX2 dot product for IQ2_XS (llama/5187)

* iq2xs: faster AVX2 dot product

* iq2xs: small AVX2 imrovement

* Speed up computing sign bits in AVX2 iq2_xs dot product

---------

Co-authored-by: Iwan Kawrakow <redacted>
Co-authored-by: Peter Reid <redacted>
src/ggml-quants.c diff | blob | history
Packaging of ggml-org/ggml