From: Daniel Bevenius Date: Tue, 16 Apr 2024 06:34:06 +0000 (+0200) Subject: gritlm : add --outdir option to hf.sh script (#6699) X-Git-Tag: upstream/0.0.4488~1805 X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=8a56075b07a8b571bf95a912ffdce4c928c2b414;p=pkg%2Fggml%2Fsources%2Fllama.cpp gritlm : add --outdir option to hf.sh script (#6699) This commit updates the hf.sh script usage to include the --outdir option and specifies the models directory as the output directory. The motivation for this is to avoid cluttering the root directory with model files. Signed-off-by: Daniel Bevenius --- diff --git a/examples/gritlm/README.md b/examples/gritlm/README.md index 64cc1920..a3a3c138 100644 --- a/examples/gritlm/README.md +++ b/examples/gritlm/README.md @@ -21,12 +21,12 @@ not have to be performed at all. ### Running the example Download a Grit model: ```console -$ scripts/hf.sh --repo cohesionet/GritLM-7B_gguf --file gritlm-7b_q4_1.gguf +$ scripts/hf.sh --repo cohesionet/GritLM-7B_gguf --file gritlm-7b_q4_1.gguf --outdir models ``` Run the example using the downloaded model: ```console -$ ./gritlm -m gritlm-7b_q4_1.gguf +$ ./gritlm -m models/gritlm-7b_q4_1.gguf Cosine similarity between "Bitcoin: A Peer-to-Peer Electronic Cash System" and "A purely peer-to-peer version of electronic cash w" is: 0.605 Cosine similarity between "Bitcoin: A Peer-to-Peer Electronic Cash System" and "All text-based language problems can be reduced to" is: 0.103