]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml : importance matrix support for legacy quants (llama/4969)
authorKawrakow <redacted>
Tue, 16 Jan 2024 17:51:26 +0000 (19:51 +0200)
committerGeorgi Gerganov <redacted>
Wed, 17 Jan 2024 19:21:10 +0000 (21:21 +0200)
commit01637e1a4c3c266cad010bf4121c599378785e6a
treee2edf7cbe0889e73faf1ce81491766dae128ba68
parent1b349eb1f9181d59c03199b62687c09cb569e6aa
ggml : importance matrix support for legacy quants (llama/4969)

* imatrix: adding support for legacy quants

* imatrix: guard Q4_0/Q5_0 against ffn_down craziness

---------

Co-authored-by: Iwan Kawrakow <redacted>
ggml-quants.c
ggml-quants.h
ggml.c