Skip to content

Commit ff57581

Browse files
authored
chore(model gallery): add MiniCPM series models (#10699)
Add 9 MiniCPM models to the gallery: - MiniCPM-V 4.6 (1.3B multimodal, edge-optimized) - MiniCPM-V 4.6 Thinking (1.3B multimodal with reasoning) - MiniCPM-V 4 (multimodal) - MiniCPM-o 4.5 (8B omni-modal, vision+speech) - MiniCPM-o 2.6 (7.6B omni-modal) - MiniCPM5-1B (text) - MiniCPM4.1-8B (text) - MiniCPM4-8B (text) - MiniCPM3-4B (text) All sha256 checksums sourced from HuggingFace LFS metadata. Signed-off-by: Dennis Huang <huangsiyuan20060408@hotmail.com>
1 parent 29db4ab commit ff57581

1 file changed

Lines changed: 217 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 217 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13475,6 +13475,223 @@
1347513475
- filename: minicpm-v-4_5-mmproj-f16.gguf
1347613476
sha256: 7a7225a32e8d453aaa3d22d8c579b5bf833c253f784cdb05c99c9a76fd616df8
1347713477
uri: huggingface://openbmb/MiniCPM-V-4_5-gguf/mmproj-model-f16.gguf
13478+
- name: minicpm-v-4_6
13479+
url: github:mudler/LocalAI/gallery/qwen3.yaml@master
13480+
urls:
13481+
- https://huggingface.co/openbmb/MiniCPM-V-4.6-gguf
13482+
- https://huggingface.co/openbmb/MiniCPM-V-4.6
13483+
description: |
13484+
MiniCPM-V 4.6 is the most edge-deployment-friendly model in the MiniCPM-V series, with a total of 1.3B parameters. Built on Qwen3.5-0.8B and SigLIP2-400M, it features ultra-efficient architecture with mixed 4x/16x visual token compression for on-device deployment on iOS, Android, and HarmonyOS.
13485+
license: apache-2.0
13486+
icon: https://avatars.githubusercontent.com/u/89920203
13487+
tags:
13488+
- llm
13489+
- multimodal
13490+
- gguf
13491+
- gpu
13492+
- qwen3
13493+
- cpu
13494+
overrides:
13495+
mmproj: minicpm-v-4_6-mmproj-f16.gguf
13496+
parameters:
13497+
model: minicpm-v-4_6-Q4_K_M.gguf
13498+
files:
13499+
- filename: minicpm-v-4_6-Q4_K_M.gguf
13500+
sha256: 6b0c74962c44bc6bf4b655b9b02c13eda9d5a0491543ae976d1ac18e4b7892e2
13501+
uri: huggingface://openbmb/MiniCPM-V-4.6-gguf/MiniCPM-V-4_6-Q4_K_M.gguf
13502+
- filename: minicpm-v-4_6-mmproj-f16.gguf
13503+
sha256: ca931d861d0801d9003e50697cd764721a334107c0e0415a51168ee1938462de
13504+
uri: huggingface://openbmb/MiniCPM-V-4.6-gguf/mmproj-model-f16.gguf
13505+
- name: minicpm5-1b
13506+
url: github:mudler/LocalAI/gallery/chatml.yaml@master
13507+
urls:
13508+
- https://huggingface.co/openbmb/MiniCPM5-1B-GGUF
13509+
- https://huggingface.co/openbmb/MiniCPM5-1B
13510+
description: |
13511+
MiniCPM5-1B is a compact 1B-parameter language model based on the LLaMA architecture. Despite its small size, it achieves competitive performance among sub-2B models, making it ideal for edge deployment and resource-constrained environments.
13512+
license: apache-2.0
13513+
icon: https://avatars.githubusercontent.com/u/89920203
13514+
tags:
13515+
- llm
13516+
- gguf
13517+
- gpu
13518+
- cpu
13519+
overrides:
13520+
parameters:
13521+
model: MiniCPM5-1B-Q4_K_M.gguf
13522+
files:
13523+
- filename: MiniCPM5-1B-Q4_K_M.gguf
13524+
sha256: 81b64d05a23b17b34c475f42b3e72fbde62d4b92cc34541f7a8031d0752deafa
13525+
uri: huggingface://openbmb/MiniCPM5-1B-GGUF/MiniCPM5-1B-Q4_K_M.gguf
13526+
- name: minicpm-o-4_5
13527+
url: github:mudler/LocalAI/gallery/qwen3.yaml@master
13528+
urls:
13529+
- https://huggingface.co/openbmb/MiniCPM-o-4_5-gguf
13530+
- https://huggingface.co/openbmb/MiniCPM-o-4_5
13531+
description: |
13532+
MiniCPM-o 4.5 is the latest omni-modal model in the MiniCPM series. Built on Qwen3-8B and SigLIP2-400M, it supports vision, speech, and text in a unified 8B-parameter architecture with full-duplex real-time streaming.
13533+
license: apache-2.0
13534+
icon: https://avatars.githubusercontent.com/u/89920203
13535+
tags:
13536+
- llm
13537+
- multimodal
13538+
- gguf
13539+
- gpu
13540+
- qwen3
13541+
- cpu
13542+
overrides:
13543+
mmproj: minicpm-o-4_5-mmproj-f16.gguf
13544+
parameters:
13545+
model: minicpm-o-4_5-Q4_K_M.gguf
13546+
files:
13547+
- filename: minicpm-o-4_5-Q4_K_M.gguf
13548+
sha256: 1237a97ee081b8abebc47aa7dad565701e8f5f904cdc92f6723ac4281bbc0932
13549+
uri: huggingface://openbmb/MiniCPM-o-4_5-gguf/MiniCPM-o-4_5-Q4_K_M.gguf
13550+
- filename: minicpm-o-4_5-mmproj-f16.gguf
13551+
sha256: 1453678cc4e4fe18de241952962e234f265cb8dda780773526103ab8ba82f421
13552+
uri: huggingface://openbmb/MiniCPM-o-4_5-gguf/vision/MiniCPM-o-4_5-vision-F16.gguf
13553+
- name: minicpm-v-4_6-thinking
13554+
url: github:mudler/LocalAI/gallery/qwen3.yaml@master
13555+
urls:
13556+
- https://huggingface.co/openbmb/MiniCPM-V-4.6-Thinking-gguf
13557+
- https://huggingface.co/openbmb/MiniCPM-V-4.6-Thinking
13558+
description: |
13559+
MiniCPM-V 4.6 Thinking is the reasoning-enhanced version of MiniCPM-V 4.6, with a total of 1.3B parameters. Built on Qwen3.5-0.8B and SigLIP2-400M, it features extended thinking capabilities for complex visual reasoning tasks while maintaining an ultra-compact architecture for edge deployment.
13560+
license: apache-2.0
13561+
icon: https://avatars.githubusercontent.com/u/89920203
13562+
tags:
13563+
- llm
13564+
- multimodal
13565+
- gguf
13566+
- gpu
13567+
- qwen3
13568+
- cpu
13569+
overrides:
13570+
mmproj: minicpm-v-4_6-thinking-mmproj-f16.gguf
13571+
parameters:
13572+
model: MiniCPM-V-4_6-Thinking-Q4_K_M.gguf
13573+
files:
13574+
- filename: MiniCPM-V-4_6-Thinking-Q4_K_M.gguf
13575+
sha256: 2d15cea059289533a4e51cff895888a2afaf8ed0c88bcc11ba590d2a45c6f174
13576+
uri: huggingface://openbmb/MiniCPM-V-4.6-Thinking-gguf/MiniCPM-V-4_6-Thinking-Q4_K_M.gguf
13577+
- filename: minicpm-v-4_6-thinking-mmproj-f16.gguf
13578+
sha256: b9d09d261de167b291a69958b520c6411877cbff50e96a83d06e9835627c70f6
13579+
uri: huggingface://openbmb/MiniCPM-V-4.6-Thinking-gguf/mmproj-model-f16.gguf
13580+
- name: minicpm-v-4
13581+
url: github:mudler/LocalAI/gallery/chatml.yaml@master
13582+
urls:
13583+
- https://huggingface.co/openbmb/MiniCPM-V-4-gguf
13584+
- https://huggingface.co/openbmb/MiniCPM-V-4
13585+
description: |
13586+
MiniCPM-V 4 is a multimodal large language model in the MiniCPM-V series, supporting image and video understanding with strong OCR and multi-image capabilities.
13587+
license: apache-2.0
13588+
icon: https://avatars.githubusercontent.com/u/89920203
13589+
tags:
13590+
- llm
13591+
- multimodal
13592+
- gguf
13593+
- gpu
13594+
- cpu
13595+
overrides:
13596+
mmproj: minicpm-v-4-mmproj-f16.gguf
13597+
parameters:
13598+
model: minicpm-v-4-Q4_K_M.gguf
13599+
files:
13600+
- filename: minicpm-v-4-Q4_K_M.gguf
13601+
sha256: b0ff610e9c92b30389ff1e0dd40fffed3c1f02a9d34a735fd5fba6a5ad25672b
13602+
uri: huggingface://openbmb/MiniCPM-V-4-gguf/ggml-model-Q4_K_M.gguf
13603+
- filename: minicpm-v-4-mmproj-f16.gguf
13604+
sha256: f0faa9ae63532300999c86a196f140c716cd0fbb08bbbd81850f1f9a631f7761
13605+
uri: huggingface://openbmb/MiniCPM-V-4-gguf/mmproj-model-f16.gguf
13606+
- name: minicpm3-4b
13607+
url: github:mudler/LocalAI/gallery/chatml.yaml@master
13608+
urls:
13609+
- https://huggingface.co/openbmb/MiniCPM3-4B-GGUF
13610+
- https://huggingface.co/openbmb/MiniCPM3-4B
13611+
description: |
13612+
MiniCPM3-4B is a 4B-parameter language model that surpasses many larger models. It features enhanced long-context capability up to 32K tokens, strong function calling, and improved instruction following.
13613+
license: apache-2.0
13614+
icon: https://avatars.githubusercontent.com/u/89920203
13615+
tags:
13616+
- llm
13617+
- gguf
13618+
- gpu
13619+
- cpu
13620+
overrides:
13621+
parameters:
13622+
model: minicpm3-4b-q4_k_m.gguf
13623+
files:
13624+
- filename: minicpm3-4b-q4_k_m.gguf
13625+
sha256: 64913247e927414ecf47fd3e9ea8e3f0c9acae293f583dfa7e24b8872e20fa4c
13626+
uri: huggingface://openbmb/MiniCPM3-4B-GGUF/minicpm3-4b-q4_k_m.gguf
13627+
- name: minicpm-o-2_6
13628+
url: github:mudler/LocalAI/gallery/chatml.yaml@master
13629+
urls:
13630+
- https://huggingface.co/openbmb/MiniCPM-o-2_6-gguf
13631+
- https://huggingface.co/openbmb/MiniCPM-o-2_6
13632+
description: |
13633+
MiniCPM-o 2.6 is an omni-modal model supporting vision, speech, and text. Based on a 7.6B-parameter architecture with SigLIP-400M and Whisper-medium, it offers real-time speech conversation and multimodal live streaming capabilities.
13634+
license: apache-2.0
13635+
icon: https://avatars.githubusercontent.com/u/89920203
13636+
tags:
13637+
- llm
13638+
- multimodal
13639+
- gguf
13640+
- gpu
13641+
- cpu
13642+
overrides:
13643+
mmproj: minicpm-o-2_6-mmproj-f16.gguf
13644+
parameters:
13645+
model: minicpm-o-2_6-Q4_K_M.gguf
13646+
files:
13647+
- filename: minicpm-o-2_6-Q4_K_M.gguf
13648+
sha256: 4f635fc0c0bb88d50ccd9cf1f1e5892b5cb085ff88fe0d8e1148fd9a8a836bc2
13649+
uri: huggingface://openbmb/MiniCPM-o-2_6-gguf/Model-7.6B-Q4_K_M.gguf
13650+
- filename: minicpm-o-2_6-mmproj-f16.gguf
13651+
sha256: efa4f7d96aa0f838f2023fc8d28e519179b16f1106777fa9280b32628191aa3e
13652+
uri: huggingface://openbmb/MiniCPM-o-2_6-gguf/mmproj-model-f16.gguf
13653+
- name: minicpm4_1-8b
13654+
url: github:mudler/LocalAI/gallery/chatml.yaml@master
13655+
urls:
13656+
- https://huggingface.co/openbmb/MiniCPM4.1-8B-GGUF
13657+
- https://huggingface.co/openbmb/MiniCPM4.1-8B
13658+
description: |
13659+
MiniCPM4.1-8B is an 8B-parameter language model with enhanced capabilities in coding, mathematics, and instruction following, building upon the MiniCPM4 architecture.
13660+
license: apache-2.0
13661+
icon: https://avatars.githubusercontent.com/u/89920203
13662+
tags:
13663+
- llm
13664+
- gguf
13665+
- gpu
13666+
- cpu
13667+
overrides:
13668+
parameters:
13669+
model: MiniCPM4.1-8B-Q4_K_M.gguf
13670+
files:
13671+
- filename: MiniCPM4.1-8B-Q4_K_M.gguf
13672+
sha256: 9d2ffb9145bf7a88ddb94b2542b42d925293666c42962aa158eeb62fc9708654
13673+
uri: huggingface://openbmb/MiniCPM4.1-8B-GGUF/MiniCPM4.1-8B-Q4_K_M.gguf
13674+
- name: minicpm4-8b
13675+
url: github:mudler/LocalAI/gallery/chatml.yaml@master
13676+
urls:
13677+
- https://huggingface.co/openbmb/MiniCPM4-8B-GGUF
13678+
- https://huggingface.co/openbmb/MiniCPM4-8B
13679+
description: |
13680+
MiniCPM4-8B is an 8B-parameter language model achieving competitive performance among models of similar size, with strong capabilities in reasoning, coding, and multilingual tasks.
13681+
license: apache-2.0
13682+
icon: https://avatars.githubusercontent.com/u/89920203
13683+
tags:
13684+
- llm
13685+
- gguf
13686+
- gpu
13687+
- cpu
13688+
overrides:
13689+
parameters:
13690+
model: MiniCPM4-8B-Q4_K_M.gguf
13691+
files:
13692+
- filename: MiniCPM4-8B-Q4_K_M.gguf
13693+
sha256: 80b99ec4ceac302e7d474c8659e96b9f6c3bbeb73c41b2ef841c7fcb6d8250f3
13694+
uri: huggingface://openbmb/MiniCPM4-8B-GGUF/MiniCPM4-8B-Q4_K_M.gguf
1347813695
- name: aquif-ai_aquif-3.5-8b-think
1347913696
url: github:mudler/LocalAI/gallery/qwen3.yaml@master
1348013697
urls:

0 commit comments

Comments
 (0)