]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commitdiff
add example of re-act pattern (#583)
authorTobias Lütke <redacted>
Wed, 29 Mar 2023 15:10:24 +0000 (17:10 +0200)
committerGitHub <redacted>
Wed, 29 Mar 2023 15:10:24 +0000 (10:10 -0500)
* add example of re-act pattern

* spelling...

* fixed whitespace in reverse prompt issue

examples/reason-act.sh [new file with mode: 0755]
prompts/reason-act.txt [new file with mode: 0644]

diff --git a/examples/reason-act.sh b/examples/reason-act.sh
new file mode 100755 (executable)
index 0000000..e7fe655
--- /dev/null
@@ -0,0 +1,17 @@
+
+#!/bin/bash
+
+cd `dirname $0`
+cd ..
+
+# get -m model parameter otherwise defer to default
+if [ "$1" == "-m" ]; then
+  MODEL="-m $2 "
+fi
+
+./main $MODEL --color \
+    -f ./prompts/reason-act.txt \
+    -i --interactive-first \
+    --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7 -c 2048 \
+    -r "Question:" -r "Observation:" --in-prefix " " \
+    -n -1
diff --git a/prompts/reason-act.txt b/prompts/reason-act.txt
new file mode 100644 (file)
index 0000000..8720166
--- /dev/null
@@ -0,0 +1,18 @@
+You run in a loop of Thought, Action, Observation.
+At the end of the loop either Answer or restate your Thought and Action.
+Use Thought to describe your thoughts about the question you have been asked.
+Use Action to run one of these actions available to you:
+- calculate[python math expression]
+Observation will be the result of running those actions
+
+
+Question: What is 4 * 7 / 3?
+Thought: Do I need to use an action? Yes, I use calculate to do math
+Action: calculate[4 * 7 / 3]
+Observation: 9.3333333333
+Thought: Do I need to use an action? No, have the result
+Answer: The calculate tool says it is 9.3333333333
+Question: What is capital of france?
+Thought: Do I need to use an action? No, I know the answer
+Answer: Paris is the capital of France
+Question: