]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
whisper : fix excessive memory usage (#2443)
authorGeorgi Gerganov <redacted>
Sat, 5 Oct 2024 09:36:40 +0000 (12:36 +0300)
committerGitHub <redacted>
Sat, 5 Oct 2024 09:36:40 +0000 (12:36 +0300)
commitf62a546e03a0bae558eead57113056ee5614ea4c
tree1386771beeafba1e34f1bebf59f17bba544339e1
parent2944cb72d95282378037cb0eb45c9e2b2529ff2c
whisper : fix excessive memory usage (#2443)

* whisper : fix KV cache allocation

* whisper : reduce memory overhead from unused input tensors
src/whisper.cpp