]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
ggml : more perfo with llamafile tinyblas on x86_64 (llama/10714)
authorDjip007 <redacted>
Tue, 24 Dec 2024 17:54:49 +0000 (18:54 +0100)
committerGeorgi Gerganov <redacted>
Sat, 4 Jan 2025 08:45:01 +0000 (10:45 +0200)
commitbcf937c21690df24c415d271e540f3006bce7ccd
tree4e05b60023446f3cc5c14cafff16977fd4ea283a
parentb8d90953d75d54faa3928593c048f83e99d1a600
ggml : more perfo with llamafile tinyblas on x86_64 (llama/10714)

* more perfo with llamafile tinyblas on x86_64.

- add bf16 suport
- change dispache strategie (thanks:
https://github.com/ikawrakow/ik_llama.cpp/pull/71 )
- reduce memory bandwidth

simple tinyblas dispache and more cache freindly

* tinyblas dynamic dispaching

* sgemm: add M blocs.

* - git 2.47 use short id of len 9.
- show-progress is not part of GNU Wget2

* remove not stable test
ggml/src/ggml-cpu/ggml-cpu.c
ggml/src/ggml-cpu/llamafile/sgemm.cpp
ggml/src/ggml-cpu/llamafile/sgemm.h