]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 642330a)
server : fix default draft model parameters (#10586)
authorGeorgi Gerganov <redacted>
Tue, 3 Dec 2024 09:20:00 +0000 (11:20 +0200)
committerGitHub <redacted>
Tue, 3 Dec 2024 09:20:00 +0000 (11:20 +0200)
commit70b98fadbc8c07a0144f3b50a4d7ab7e2aeff878
tree6053304f5d69a700e50284d020f8e887a0be0421tree
parent642330ac7cea11dc1f9d3df2b8f3dbd10b5e3f3ecommit | diff
server : fix default draft model parameters (#10586)

* server : force F16 KV cache for the draft model

ggml-ci

* server : fix draft params

ggml-ci

* server : various params fixes

ggml-ci
examples/server/server.cpp diff | blob | history
Packaging of ggml-org/llama.cpp