]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
overview / pkg / ggml / sources / llama.cpp / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 7e312f1)
llama : have n_batch default to 512 (#1091)
authoreiery <redacted>
Sat, 22 Apr 2023 08:27:05 +0000 (04:27 -0400)
committerGitHub <redacted>
Sat, 22 Apr 2023 08:27:05 +0000 (11:27 +0300)
commit10f19c1121068ce3dab9bece03a8b9caaea2db36
tree669b6ce043021f01ef8ac91a2e81bfb3df1a9b6atree
parent7e312f165c5047d6e16680d1eebc83055e95c313commit | diff
llama : have n_batch default to 512 (#1091)

* set default n_batch to 512 when using BLAS

* spacing

* alternate implementation of setting different n_batch for BLAS

* set n_batch to 512 for all cases
examples/common.h diff | blob | history
Packaging of ggml-org/llama.cpp