From: Clint Herron Date: Sat, 22 Apr 2023 06:54:33 +0000 (-0400) Subject: examples : Improve Alpaca Default Repeat Penalty: Better Match Alpaca.cpp Experience... X-Git-Tag: gguf-v0.4.0~898 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=e9a9cb0c54461ffbda75b7b2f99f3ea5562291c2;p=pkg%2Fggml%2Fsources%2Fllama.cpp examples : Improve Alpaca Default Repeat Penalty: Better Match Alpaca.cpp Experience (#1107) * Moving parameters to separate lines for readability. * Increasing repeate_penalty to 1.1 to make alpaca more usable by default. * Adding trailing newline. --- diff --git a/examples/alpaca.sh b/examples/alpaca.sh index 8d626173..aef207f3 100755 --- a/examples/alpaca.sh +++ b/examples/alpaca.sh @@ -7,4 +7,13 @@ cd `dirname $0` cd .. -./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt --ctx_size 2048 -n -1 -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7 +./main -m ./models/ggml-alpaca-7b-q4.bin \ + --color \ + -f ./prompts/alpaca.txt \ + --ctx_size 2048 \ + -n -1 \ + -ins -b 256 \ + --top_k 10000 \ + --temp 0.2 \ + --repeat_penalty 1.1 \ + -t 7