]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
Some improvements to loading the session with --prompt-cache (#1550)
authorKerfuffle <redacted>
Fri, 26 May 2023 02:18:01 +0000 (20:18 -0600)
committerGitHub <redacted>
Fri, 26 May 2023 02:18:01 +0000 (20:18 -0600)
commit66874d4fbcc7866377246efbcee938e8cc9c7d76
tree503b2c4e6ddb6124342a218572166a587d8f3acb
parent1fcdcc28b119a6608774d52de905931bd5f8a43d
Some improvements to loading the session with --prompt-cache (#1550)

Improvements to loading the session with `--prompt-cache` in the `main` example.

1. Fix an issue where the `--seed` parameter was ignored when loading a cached prompt.
2. When loading a cached prompt, you previously had to specify the saved prompt (or a prefix of it) again. This pull changes that behavior to default to the prompt that was cached if a prompt wasn't specified by the user.
examples/main/README.md
examples/main/main.cpp