]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
Faster AVX2 dot product for IQ2_XS (llama/5187)
authorKawrakow <redacted>
Tue, 30 Jan 2024 13:15:07 +0000 (15:15 +0200)
committerGeorgi Gerganov <redacted>
Tue, 30 Jan 2024 19:27:59 +0000 (21:27 +0200)
commit98ae5276b7cadc75652b459553da9ac9ecd50e67
tree3ba1e735ea0276e47d75873aa581334b2d78a955
parent6adb969b090758f3001f38de4e9c1c169ef1c8c0
Faster AVX2 dot product for IQ2_XS (llama/5187)

* iq2xs: faster AVX2 dot product

* iq2xs: small AVX2 imrovement

* Speed up computing sign bits in AVX2 iq2_xs dot product

---------

Co-authored-by: Iwan Kawrakow <redacted>
Co-authored-by: Peter Reid <redacted>
ggml-quants.c