diff options
| author | Mitja Felicijan <mitja.felicijan@gmail.com> | 2026-02-12 20:57:17 +0100 |
|---|---|---|
| committer | Mitja Felicijan <mitja.felicijan@gmail.com> | 2026-02-12 20:57:17 +0100 |
| commit | b333b06772c89d96aacb5490d6a219fba7c09cc6 (patch) | |
| tree | 211df60083a5946baa2ed61d33d8121b7e251b06 /llama.cpp/examples/reason-act.sh | |
| download | llmnpc-b333b06772c89d96aacb5490d6a219fba7c09cc6.tar.gz | |
Engage!
Diffstat (limited to 'llama.cpp/examples/reason-act.sh')
| -rwxr-xr-x | llama.cpp/examples/reason-act.sh | 16 |
1 files changed, 16 insertions, 0 deletions
diff --git a/llama.cpp/examples/reason-act.sh b/llama.cpp/examples/reason-act.sh new file mode 100755 index 0000000..3c80192 --- /dev/null +++ b/llama.cpp/examples/reason-act.sh @@ -0,0 +1,16 @@ +#!/usr/bin/env bash + +cd `dirname $0` +cd .. + +# get -m model parameter otherwise defer to default +if [ "$1" == "-m" ]; then + MODEL="-m $2 " +fi + +./llama-cli $MODEL --color \ + -f ./prompts/reason-act.txt \ + -i --interactive-first \ + --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7 -c 2048 \ + -r "Question:" -r "Observation:" --in-prefix " " \ + -n -1 |