]> git.djapps.eu Git - pkg/ggml/sources/whisper.cpp/commit
whisper : make beam candidate sort more stable (#1943)
authorJosh Bleecher Snyder <redacted>
Sat, 9 Mar 2024 16:50:03 +0000 (08:50 -0800)
committerGitHub <redacted>
Sat, 9 Mar 2024 16:50:03 +0000 (18:50 +0200)
commit2852e1af55b1a2c180e608e62c0a0f0ab18bba10
treeb3ddc1d9404b452f225a524d97850e5c6d1a860b
parentce945b50c3d6e0561fa74e3e42e1cf5ef3e84598
whisper : make beam candidate sort more stable (#1943)

All else being otherwise equal, this encourages the beam candidate
selection to re-use the same decoder, which slightly
reduces the cache size.

I wouldn't expect it to make much of a performance difference,
but it helps when debug printing the cache and beam.

Added as part of understanding #1941.
whisper.cpp