]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server: tests: add truncated prompt tests, better kv cache size (#5933)
authorPierrick Hymbert <redacted>
Sat, 9 Mar 2024 09:30:04 +0000 (10:30 +0100)
committerGitHub <redacted>
Sat, 9 Mar 2024 09:30:04 +0000 (11:30 +0200)
commitfd72d2d2a5e79d61ccef6af3d15f16e5e5cbc352
tree3a8912adc90c34470fa1e3acb6dd861990159ec7
parentc2101a2e909ac7c08976d414e64e96c90ee5fa9e
server: tests: add truncated prompt tests, better kv cache size (#5933)

* server: tests: add truncated prompt tests, better size

* server, tests : update regex

---------

Co-authored-by: Georgi Gerganov <redacted>
examples/server/server.cpp
examples/server/tests/features/parallel.feature
examples/server/tests/features/server.feature
examples/server/tests/features/steps/steps.py