]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commitdiff
Add chat.sh script
authorGeorgi Gerganov <redacted>
Tue, 21 Mar 2023 16:09:37 +0000 (18:09 +0200)
committerGeorgi Gerganov <redacted>
Tue, 21 Mar 2023 16:09:46 +0000 (18:09 +0200)
README.md
chat.sh [new file with mode: 0755]

index f0b0c2a5b6671bfc4ed093acbe302c5e3d56be74..62cf82d85d699f2f345e38cd53d8b715d2ba1325 100644 (file)
--- a/README.md
+++ b/README.md
@@ -179,8 +179,11 @@ In this mode, you can always interrupt generation by pressing Ctrl+C and enter o
 
 Here is an example few-shot interaction, invoked with the command
 ```
-./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt
+# default arguments using 7B model
+./chat.sh
 
+# custom arguments using 13B model
+./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt
 ```
 Note the use of `--color` to distinguish between user input and generated text.
 
diff --git a/chat.sh b/chat.sh
new file mode 100755 (executable)
index 0000000..24a0f10
--- /dev/null
+++ b/chat.sh
@@ -0,0 +1,6 @@
+#!/bin/bash
+#
+# Temporary script - will be removed in the future
+#
+
+./main -m ./models/7B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt