]> git.djapps.eu Git - pkg/ggml/sources/ggml/commit
main : add options for temperature control (whisper/2088)
authorDaniel Ziegenberg <redacted>
Mon, 13 May 2024 11:59:44 +0000 (13:59 +0200)
committerGeorgi Gerganov <redacted>
Tue, 14 May 2024 12:31:03 +0000 (15:31 +0300)
commitcd33119a8343367cc458d72b95d7c05a44afddbb
tree68462896d6511c2e134315236d702bf7eee24e95
parent26fc697ba126112374aea795135038335891f3fd
main : add options for temperature control (whisper/2088)

Add two options:

```
-tp,       --temperature N     [0.00   ] The sampling temperature, between 0 and 1
-tpi,      --temperature-inc N [0.20   ] The increment of temperature, between 0 and 1
```

The sampling temperature, between 0 and 1. Higher values like 0.8 will
make the output more random, while lower values like 0.2 will make it
more focused and deterministic. If set to 0, the model will use log
probability to automatically increase the temperature until certain
thresholds are hit.

Signed-off-by: Daniel Ziegenberg <redacted>
examples/whisper/main.cpp