]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
Use Accelerate framework on Apple silicon
authorGeorgi Gerganov <redacted>
Mon, 17 Oct 2022 18:44:16 +0000 (21:44 +0300)
committerGeorgi Gerganov <redacted>
Mon, 17 Oct 2022 21:12:51 +0000 (00:12 +0300)
commit72d967bce4c03b0a48f9491129e3e0e9cd7b1e80
tree7aae15ad26f606f7c5ea5c165771b31bca42539e
parent130b5c02d6fdbf24fadde2764e8dc761cb9739d8
Use Accelerate framework on Apple silicon

Huge performance improvement in the Encode (almost x2 on MacBook M1 Pro)

Also various extra optimizations:

- Multi-threaded NORM operator
- Faster GELU via F16 cast
Makefile
README.md
ggml.c
main.cpp
whisper.cpp