]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
Add repetition penalty (#20)
authorbeiller <redacted>
Sun, 12 Mar 2023 09:27:42 +0000 (05:27 -0400)
committerGitHub <redacted>
Sun, 12 Mar 2023 09:27:42 +0000 (11:27 +0200)
commit129c7d1ea886e52ac1b87ff6184310bab3158806
treefe55fbb47ffb6bd7676890bf342c5b8c7f8c6c52
parent702fddf5c5c3c1377e169ba9ecdfed4cb16c268b
Add repetition penalty (#20)

* Adding repeat penalization

* Update utils.h

* Update utils.cpp

* Numeric fix

Should probably still scale by temp even if penalized

* Update comments, more proper application

I see that numbers can go negative so a fix from a referenced commit

* Minor formatting

---------

Co-authored-by: Georgi Gerganov <redacted>
main.cpp
utils.cpp
utils.h