]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
whisper : add GPU support via cuBLAS (#834)
authorGeorgi Gerganov <redacted>
Sun, 30 Apr 2023 09:14:33 +0000 (12:14 +0300)
committerGitHub <redacted>
Sun, 30 Apr 2023 09:14:33 +0000 (12:14 +0300)
commit5fd1bdd7fc501d1a94dcedf80ec539f696deaf3f
tree7976466208216fcd10efc9e7a16720e97b1c2156
parent0ccd6746c90716dea94efc813658a43601bf7fbd
whisper : add GPU support via cuBLAS (#834)

* make : add WHISPER_CUBLAS

* make : fix CUBLAS build

* whisper : disable Flash Attention + adjust memory buffers

* whisper : remove old commented code

* readme : add cuBLAS instructions

* cmake : add WHISPER_CUBLAS option

* gitignore : ignore build-cublas
.gitignore
CMakeLists.txt
Makefile
README.md
examples/CMakeLists.txt
examples/command/CMakeLists.txt
examples/stream/CMakeLists.txt
examples/talk-llama/CMakeLists.txt
examples/talk/CMakeLists.txt
whisper.cpp