]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 24ba3d8)
batched : add bench tool (#3545)
authorGeorgi Gerganov <redacted>
Wed, 11 Oct 2023 18:25:33 +0000 (21:25 +0300)
committerGitHub <redacted>
Wed, 11 Oct 2023 18:25:33 +0000 (21:25 +0300)
commit8c70a5ff25964f0a81e20d142a2f5ac5baff22fc
tree50946ed36e647f5619b1866d77e3042d4d9743c5tree
parent24ba3d829e31a6eda3fa1723f692608c2fa3addacommit | diff
batched : add bench tool (#3545)

* batched : add bench tool

* batched : minor fix table

* batched-bench : add readme + n_kv_max is now configurable

* batched-bench : init warm-up batch

* batched-bench : pass custom set of PP, TG and PL

* batched-bench : add mmq CLI arg
.gitignore diff | blob | history
Makefile diff | blob | history
examples/CMakeLists.txt diff | blob | history
examples/batched-bench/CMakeLists.txt [new file with mode: 0644] blob
examples/batched-bench/README.md [new file with mode: 0644] blob
examples/batched-bench/batched-bench.cpp [new file with mode: 0644] blob
examples/batched/batched.cpp diff | blob | history
Packaging of ggml-org/llama.cpp