]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
server : enable continuous batching by default (#6231)
authorGeorgi Gerganov <redacted>
Fri, 22 Mar 2024 11:08:28 +0000 (13:08 +0200)
committerGitHub <redacted>
Fri, 22 Mar 2024 11:08:28 +0000 (13:08 +0200)
commit68e210b3543e0cc71268bee0920441747679ee13
treea6c4d546faad2bf5b2921978f5f583fdb52cdd19
parentb3e94f26bab8e3b5338b5902e5af5bb01894cb4a
server : enable continuous batching by default (#6231)
common/common.h
examples/server/server.cpp