]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 3e5ca79)
speculative : threading options (#4959)
authorstduhpf <redacted>
Tue, 16 Jan 2024 11:04:32 +0000 (12:04 +0100)
committerGitHub <redacted>
Tue, 16 Jan 2024 11:04:32 +0000 (13:04 +0200)
commite0324285a569d0583cf2f4a07a2402221ee25f58
tree8372c01c23d94190463f02c5e643142995aa7f84tree
parent3e5ca7931c68152e4ec18d126e9c832dd84914c8commit | diff
speculative : threading options (#4959)

* speculative: expose draft threading

* fix usage format

* accept -td and -tbd args

* speculative: revert default behavior when -td is unspecified

* fix trailing whitespace
common/common.cpp diff | blob | history
common/common.h diff | blob | history
examples/speculative/speculative.cpp diff | blob | history
Packaging of ggml-org/llama.cpp