]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
mtmd : support MiniCPM-V 4.6 (#22529)
authortc-mb <redacted>
Wed, 6 May 2026 19:54:09 +0000 (03:54 +0800)
committerGitHub <redacted>
Wed, 6 May 2026 19:54:09 +0000 (21:54 +0200)
commit2496f9c14965c39589f53eea31bdb6d762b1d360
tree03062b40da9d3e5f41b75f169bb7ed0af5deb163
parent5207d120eac2393fdad6328b44dbcbfc5dea20e4
mtmd : support MiniCPM-V 4.6 (#22529)

* Support MiniCPM-V 4.6 in new branch

Signed-off-by: tc-mb <redacted>
* fix code bug

Signed-off-by: tc-mb <redacted>
* fix pre-commit

Signed-off-by: tc-mb <redacted>
* fix convert

Signed-off-by: tc-mb <redacted>
* rename clip_graph_minicpmv4_6

Signed-off-by: tc-mb <redacted>
* use new TYPE_MINICPMV4_6

Signed-off-by: tc-mb <redacted>
* use build_attn to allow flash attention support

Signed-off-by: tc-mb <redacted>
* no use legacy code, restored here.

Signed-off-by: tc-mb <redacted>
* use the existing tensors name

Signed-off-by: tc-mb <redacted>
* unused ctx->model.hparams.minicpmv_version

Signed-off-by: tc-mb <redacted>
* use n_merge for slice alignment

Signed-off-by: tc-mb <redacted>
* borrow wa_layer_indexes for vit_merger insertion point

Signed-off-by: tc-mb <redacted>
* fix code style

Signed-off-by: tc-mb <redacted>
* Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret <redacted>
* use filter_tensors and add model.vision_tower

Signed-off-by: tc-mb <redacted>
* fix chkhsh

Signed-off-by: tc-mb <redacted>
* fix type check

Signed-off-by: tc-mb <redacted>
---------

Signed-off-by: tc-mb <redacted>
Co-authored-by: Sigbjørn Skjæret <redacted>
13 files changed:
convert_hf_to_gguf.py
convert_hf_to_gguf_update.py
docs/multimodal/minicpmv4.6.md [new file with mode: 0644]
gguf-py/gguf/constants.py
gguf-py/gguf/tensor_mapping.py
tools/mtmd/README.md
tools/mtmd/clip-impl.h
tools/mtmd/clip-model.h
tools/mtmd/clip.cpp
tools/mtmd/models/minicpmv.cpp
tools/mtmd/models/models.h
tools/mtmd/mtmd-image.cpp
tools/mtmd/mtmd.cpp