]> git.djapps.eu Git - pkg/ggml/sources/llama.cpp/commit
model: support GLM4V vision encoder (#18042)
authorXuan-Son Nguyen <redacted>
Tue, 16 Dec 2025 10:25:26 +0000 (11:25 +0100)
committerGitHub <redacted>
Tue, 16 Dec 2025 10:25:26 +0000 (11:25 +0100)
commit3d86c6c2b546ae5ce9cdee3ca0ac4a8181e0a073
treed41ee1011e416186e5c06085bdc1e41a9bfecda5
parent9963b81f6392da8066958c177db77ad4b4a8f284
model: support GLM4V vision encoder (#18042)

* convert ok

* no deepstack

* less new tensors

* cgraph ok

* add mrope for text model

* faster patch merger

* add GGML_ROPE_TYPE_MRNORM

* add support for metal

* move glm4v do dedicated graph

* convert: add norm_embd

* clip: add debugging fn

* working correctly

* fix style

* use bicubic

* fix mrope metal

* improve cpu

* convert to neox ordering on conversion

* revert backend changes

* force stop if using old weight

* support moe variant

* fix conversion

* fix convert (2)

* Update tools/mtmd/clip-graph.h

Co-authored-by: Georgi Gerganov <redacted>
* process mrope_section on TextModel base class

* resolve conflict merge

---------

Co-authored-by: Georgi Gerganov <redacted>
17 files changed:
convert_hf_to_gguf.py
gguf-py/gguf/constants.py
gguf-py/gguf/tensor_mapping.py
src/llama-hparams.cpp
src/llama-hparams.h
src/llama-model.cpp
src/models/glm4-moe.cpp
src/models/glm4.cpp
tools/mtmd/CMakeLists.txt
tools/mtmd/clip-graph.h
tools/mtmd/clip-impl.h
tools/mtmd/clip-model.h
tools/mtmd/clip.cpp
tools/mtmd/clip.h
tools/mtmd/models/glm4v.cpp [new file with mode: 0644]
tools/mtmd/models/models.h
tools/mtmd/mtmd.cpp