]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
mtmd: add batching API (#24384)
authorXuan-Son Nguyen <redacted>
Fri, 12 Jun 2026 22:10:29 +0000 (00:10 +0200)
committerGitHub <redacted>
Fri, 12 Jun 2026 22:10:29 +0000 (00:10 +0200)
commite37abd6b5fc91ba951d5b08ac7cdf2bc225512b6
tree6821946028c5379714ed75beaabb1263f1ea623c
parentf58bad4137c300112cb8c5d60d91e9c56fa85ad9
mtmd: add batching API (#24384)

* mtmd: add batching API

* wip

* first working version (gemma4v)

* add arg

* nits

* wire up support_batch()

* fix 0.0 output embd

* fix audio

* nits

* refactor a bit

* nits

* fix non-batching case

* fix comment
14 files changed:
common/arg.cpp
common/common.h
tools/mtmd/clip-graph.h
tools/mtmd/clip.cpp
tools/mtmd/clip.h
tools/mtmd/models/gemma4v.cpp
tools/mtmd/models/models.h
tools/mtmd/mtmd-helper.h
tools/mtmd/mtmd.cpp
tools/mtmd/mtmd.h
tools/server/server-common.cpp
tools/server/server-common.h
tools/server/server-context.cpp
tools/server/server-http.cpp