Skip to content

[Model] Support MiniCPM-V 4.6#22529

Open
tc-mb wants to merge 12 commits intoggml-org:masterfrom
tc-mb:Support-MiniCPM-V-4.6
Open

[Model] Support MiniCPM-V 4.6#22529
tc-mb wants to merge 12 commits intoggml-org:masterfrom
tc-mb:Support-MiniCPM-V-4.6

Conversation

@tc-mb
Copy link
Copy Markdown
Contributor

@tc-mb tc-mb commented Apr 29, 2026

This PR adds support for MiniCPM-V 4.6.

  1. v4.6 reworks the vision tower — the resampler is replaced by a new merger structure, which improves ViT efficiency.
  2. The GGUF conversion is also folded into the standard convert_hf_to_gguf.py flow.

tc-mb added 2 commits April 29, 2026 23:32
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
@tc-mb tc-mb requested review from a team and CISC as code owners April 29, 2026 18:50
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
@github-actions github-actions Bot added documentation Improvements or additions to documentation examples python python script changes labels Apr 29, 2026
Comment thread convert_hf_to_gguf.py
Comment thread convert_hf_to_gguf.py Outdated
Copy link
Copy Markdown
Contributor

@ngxson ngxson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please change the naming to minicpmv2_6 everywhere for consistency

Comment thread tools/mtmd/models/minicpmv.cpp Outdated
Comment thread tools/mtmd/models/models.h Outdated
Comment thread tools/mtmd/clip-model.h Outdated
Comment thread tools/mtmd/mtmd.cpp Outdated
tc-mb added 6 commits April 30, 2026 09:46
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Comment thread tools/mtmd/mtmd-image.h Outdated
Comment thread tools/mtmd/mtmd-image.h Outdated
Comment thread convert_hf_to_gguf.py Outdated
Comment thread convert_hf_to_gguf.py Outdated
Comment thread convert_hf_to_gguf.py Outdated
Comment thread convert_hf_to_gguf.py Outdated
tc-mb added 3 commits May 1, 2026 23:38
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation examples python python script changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants