]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 92139b9)
If first token generated from the server is the stop word the server will crash ...
authormaor-ps <redacted>
Sat, 4 May 2024 09:06:40 +0000 (12:06 +0300)
committerGitHub <redacted>
Sat, 4 May 2024 09:06:40 +0000 (11:06 +0200)
commit03fb8a002df2e96104f9e06de9c78d2a8ed91e92
tree1795330f5b96b4cecd41fff6358bbaf792603f60tree
parent92139b90af4841d7fd060b526bdd443b621770ffcommit | diff
If first token generated from the server is the stop word the server will crash (#7038)

This will reproduce the issue in llama13b
{
'prompt': 'Q: hello world \nA: ',
 'stop': ['\n'],
 'temperature': 0.0,
 'n_predict': 10,
 'cache_prompt': True,
 'n_probs': 10
}
examples/server/server.cpp diff | blob | history
Packaging of ggml-org/llama.cpp