]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
whisper : make beam candidate sort more stable (whisper/1943)
authorJosh Bleecher Snyder <redacted>
Sat, 9 Mar 2024 16:50:03 +0000 (08:50 -0800)
committerGeorgi Gerganov <redacted>
Sun, 10 Mar 2024 18:05:25 +0000 (20:05 +0200)
commit86961f54d35b39919780111dff69a1a040c81d0a
treea74eb28f3ad31f6a1958dc4f0fd82567bf06bd0f
parentc7cacd03925987975ddc0308a3e114d4c337d5ad
whisper : make beam candidate sort more stable (whisper/1943)

All else being otherwise equal, this encourages the beam candidate
selection to re-use the same decoder, which slightly
reduces the cache size.

I wouldn't expect it to make much of a performance difference,
but it helps when debug printing the cache and beam.

Added as part of understanding #1941.
examples/whisper/whisper.cpp