]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
common : disable KV cache shifting automatically for unsupported models (#11053)
authorMolly Sophia <redacted>
Fri, 3 Jan 2025 12:13:18 +0000 (20:13 +0800)
committerGitHub <redacted>
Fri, 3 Jan 2025 12:13:18 +0000 (14:13 +0200)
commit4b0c638b9a68f577cb2066b638c9f622d91ee661
treebf1b3bb1b0bcbfea284fe88a867c2fc6dc6dcd8b
parente7da954eccdf39ee795a6135bdb86f0978902681
common : disable KV cache shifting automatically for unsupported models (#11053)

* Disable KV cache shifting automatically for unsupported models

instead of exiting directly

Signed-off-by: Molly Sophia <redacted>
* Update common/common.cpp

Co-authored-by: Georgi Gerganov <redacted>
---------

Signed-off-by: Molly Sophia <redacted>
Co-authored-by: Georgi Gerganov <redacted>
common/common.cpp