]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
speculative : threading options (#4959)
authorstduhpf <redacted>
Tue, 16 Jan 2024 11:04:32 +0000 (12:04 +0100)
committerGitHub <redacted>
Tue, 16 Jan 2024 11:04:32 +0000 (13:04 +0200)
commite0324285a569d0583cf2f4a07a2402221ee25f58
tree8372c01c23d94190463f02c5e643142995aa7f84
parent3e5ca7931c68152e4ec18d126e9c832dd84914c8
speculative : threading options (#4959)

* speculative: expose draft threading

* fix usage format

* accept -td and -tbd args

* speculative: revert default behavior when -td is unspecified

* fix trailing whitespace
common/common.cpp
common/common.h
examples/speculative/speculative.cpp