@@ -13475,6 +13475,223 @@
1347513475 - filename: minicpm-v-4_5-mmproj-f16.gguf
1347613476 sha256: 7a7225a32e8d453aaa3d22d8c579b5bf833c253f784cdb05c99c9a76fd616df8
1347713477 uri: huggingface://openbmb/MiniCPM-V-4_5-gguf/mmproj-model-f16.gguf
13478+ - name: minicpm-v-4_6
13479+ url: github:mudler/LocalAI/gallery/qwen3.yaml@master
13480+ urls:
13481+ - https://huggingface.co/openbmb/MiniCPM-V-4.6-gguf
13482+ - https://huggingface.co/openbmb/MiniCPM-V-4.6
13483+ description: |
13484+ MiniCPM-V 4.6 is the most edge-deployment-friendly model in the MiniCPM-V series, with a total of 1.3B parameters. Built on Qwen3.5-0.8B and SigLIP2-400M, it features ultra-efficient architecture with mixed 4x/16x visual token compression for on-device deployment on iOS, Android, and HarmonyOS.
13485+ license: apache-2.0
13486+ icon: https://avatars.githubusercontent.com/u/89920203
13487+ tags:
13488+ - llm
13489+ - multimodal
13490+ - gguf
13491+ - gpu
13492+ - qwen3
13493+ - cpu
13494+ overrides:
13495+ mmproj: minicpm-v-4_6-mmproj-f16.gguf
13496+ parameters:
13497+ model: minicpm-v-4_6-Q4_K_M.gguf
13498+ files:
13499+ - filename: minicpm-v-4_6-Q4_K_M.gguf
13500+ sha256: 6b0c74962c44bc6bf4b655b9b02c13eda9d5a0491543ae976d1ac18e4b7892e2
13501+ uri: huggingface://openbmb/MiniCPM-V-4.6-gguf/MiniCPM-V-4_6-Q4_K_M.gguf
13502+ - filename: minicpm-v-4_6-mmproj-f16.gguf
13503+ sha256: ca931d861d0801d9003e50697cd764721a334107c0e0415a51168ee1938462de
13504+ uri: huggingface://openbmb/MiniCPM-V-4.6-gguf/mmproj-model-f16.gguf
13505+ - name: minicpm5-1b
13506+ url: github:mudler/LocalAI/gallery/chatml.yaml@master
13507+ urls:
13508+ - https://huggingface.co/openbmb/MiniCPM5-1B-GGUF
13509+ - https://huggingface.co/openbmb/MiniCPM5-1B
13510+ description: |
13511+ MiniCPM5-1B is a compact 1B-parameter language model based on the LLaMA architecture. Despite its small size, it achieves competitive performance among sub-2B models, making it ideal for edge deployment and resource-constrained environments.
13512+ license: apache-2.0
13513+ icon: https://avatars.githubusercontent.com/u/89920203
13514+ tags:
13515+ - llm
13516+ - gguf
13517+ - gpu
13518+ - cpu
13519+ overrides:
13520+ parameters:
13521+ model: MiniCPM5-1B-Q4_K_M.gguf
13522+ files:
13523+ - filename: MiniCPM5-1B-Q4_K_M.gguf
13524+ sha256: 81b64d05a23b17b34c475f42b3e72fbde62d4b92cc34541f7a8031d0752deafa
13525+ uri: huggingface://openbmb/MiniCPM5-1B-GGUF/MiniCPM5-1B-Q4_K_M.gguf
13526+ - name: minicpm-o-4_5
13527+ url: github:mudler/LocalAI/gallery/qwen3.yaml@master
13528+ urls:
13529+ - https://huggingface.co/openbmb/MiniCPM-o-4_5-gguf
13530+ - https://huggingface.co/openbmb/MiniCPM-o-4_5
13531+ description: |
13532+ MiniCPM-o 4.5 is the latest omni-modal model in the MiniCPM series. Built on Qwen3-8B and SigLIP2-400M, it supports vision, speech, and text in a unified 8B-parameter architecture with full-duplex real-time streaming.
13533+ license: apache-2.0
13534+ icon: https://avatars.githubusercontent.com/u/89920203
13535+ tags:
13536+ - llm
13537+ - multimodal
13538+ - gguf
13539+ - gpu
13540+ - qwen3
13541+ - cpu
13542+ overrides:
13543+ mmproj: minicpm-o-4_5-mmproj-f16.gguf
13544+ parameters:
13545+ model: minicpm-o-4_5-Q4_K_M.gguf
13546+ files:
13547+ - filename: minicpm-o-4_5-Q4_K_M.gguf
13548+ sha256: 1237a97ee081b8abebc47aa7dad565701e8f5f904cdc92f6723ac4281bbc0932
13549+ uri: huggingface://openbmb/MiniCPM-o-4_5-gguf/MiniCPM-o-4_5-Q4_K_M.gguf
13550+ - filename: minicpm-o-4_5-mmproj-f16.gguf
13551+ sha256: 1453678cc4e4fe18de241952962e234f265cb8dda780773526103ab8ba82f421
13552+ uri: huggingface://openbmb/MiniCPM-o-4_5-gguf/vision/MiniCPM-o-4_5-vision-F16.gguf
13553+ - name: minicpm-v-4_6-thinking
13554+ url: github:mudler/LocalAI/gallery/qwen3.yaml@master
13555+ urls:
13556+ - https://huggingface.co/openbmb/MiniCPM-V-4.6-Thinking-gguf
13557+ - https://huggingface.co/openbmb/MiniCPM-V-4.6-Thinking
13558+ description: |
13559+ MiniCPM-V 4.6 Thinking is the reasoning-enhanced version of MiniCPM-V 4.6, with a total of 1.3B parameters. Built on Qwen3.5-0.8B and SigLIP2-400M, it features extended thinking capabilities for complex visual reasoning tasks while maintaining an ultra-compact architecture for edge deployment.
13560+ license: apache-2.0
13561+ icon: https://avatars.githubusercontent.com/u/89920203
13562+ tags:
13563+ - llm
13564+ - multimodal
13565+ - gguf
13566+ - gpu
13567+ - qwen3
13568+ - cpu
13569+ overrides:
13570+ mmproj: minicpm-v-4_6-thinking-mmproj-f16.gguf
13571+ parameters:
13572+ model: MiniCPM-V-4_6-Thinking-Q4_K_M.gguf
13573+ files:
13574+ - filename: MiniCPM-V-4_6-Thinking-Q4_K_M.gguf
13575+ sha256: 2d15cea059289533a4e51cff895888a2afaf8ed0c88bcc11ba590d2a45c6f174
13576+ uri: huggingface://openbmb/MiniCPM-V-4.6-Thinking-gguf/MiniCPM-V-4_6-Thinking-Q4_K_M.gguf
13577+ - filename: minicpm-v-4_6-thinking-mmproj-f16.gguf
13578+ sha256: b9d09d261de167b291a69958b520c6411877cbff50e96a83d06e9835627c70f6
13579+ uri: huggingface://openbmb/MiniCPM-V-4.6-Thinking-gguf/mmproj-model-f16.gguf
13580+ - name: minicpm-v-4
13581+ url: github:mudler/LocalAI/gallery/chatml.yaml@master
13582+ urls:
13583+ - https://huggingface.co/openbmb/MiniCPM-V-4-gguf
13584+ - https://huggingface.co/openbmb/MiniCPM-V-4
13585+ description: |
13586+ MiniCPM-V 4 is a multimodal large language model in the MiniCPM-V series, supporting image and video understanding with strong OCR and multi-image capabilities.
13587+ license: apache-2.0
13588+ icon: https://avatars.githubusercontent.com/u/89920203
13589+ tags:
13590+ - llm
13591+ - multimodal
13592+ - gguf
13593+ - gpu
13594+ - cpu
13595+ overrides:
13596+ mmproj: minicpm-v-4-mmproj-f16.gguf
13597+ parameters:
13598+ model: minicpm-v-4-Q4_K_M.gguf
13599+ files:
13600+ - filename: minicpm-v-4-Q4_K_M.gguf
13601+ sha256: b0ff610e9c92b30389ff1e0dd40fffed3c1f02a9d34a735fd5fba6a5ad25672b
13602+ uri: huggingface://openbmb/MiniCPM-V-4-gguf/ggml-model-Q4_K_M.gguf
13603+ - filename: minicpm-v-4-mmproj-f16.gguf
13604+ sha256: f0faa9ae63532300999c86a196f140c716cd0fbb08bbbd81850f1f9a631f7761
13605+ uri: huggingface://openbmb/MiniCPM-V-4-gguf/mmproj-model-f16.gguf
13606+ - name: minicpm3-4b
13607+ url: github:mudler/LocalAI/gallery/chatml.yaml@master
13608+ urls:
13609+ - https://huggingface.co/openbmb/MiniCPM3-4B-GGUF
13610+ - https://huggingface.co/openbmb/MiniCPM3-4B
13611+ description: |
13612+ MiniCPM3-4B is a 4B-parameter language model that surpasses many larger models. It features enhanced long-context capability up to 32K tokens, strong function calling, and improved instruction following.
13613+ license: apache-2.0
13614+ icon: https://avatars.githubusercontent.com/u/89920203
13615+ tags:
13616+ - llm
13617+ - gguf
13618+ - gpu
13619+ - cpu
13620+ overrides:
13621+ parameters:
13622+ model: minicpm3-4b-q4_k_m.gguf
13623+ files:
13624+ - filename: minicpm3-4b-q4_k_m.gguf
13625+ sha256: 64913247e927414ecf47fd3e9ea8e3f0c9acae293f583dfa7e24b8872e20fa4c
13626+ uri: huggingface://openbmb/MiniCPM3-4B-GGUF/minicpm3-4b-q4_k_m.gguf
13627+ - name: minicpm-o-2_6
13628+ url: github:mudler/LocalAI/gallery/chatml.yaml@master
13629+ urls:
13630+ - https://huggingface.co/openbmb/MiniCPM-o-2_6-gguf
13631+ - https://huggingface.co/openbmb/MiniCPM-o-2_6
13632+ description: |
13633+ MiniCPM-o 2.6 is an omni-modal model supporting vision, speech, and text. Based on a 7.6B-parameter architecture with SigLIP-400M and Whisper-medium, it offers real-time speech conversation and multimodal live streaming capabilities.
13634+ license: apache-2.0
13635+ icon: https://avatars.githubusercontent.com/u/89920203
13636+ tags:
13637+ - llm
13638+ - multimodal
13639+ - gguf
13640+ - gpu
13641+ - cpu
13642+ overrides:
13643+ mmproj: minicpm-o-2_6-mmproj-f16.gguf
13644+ parameters:
13645+ model: minicpm-o-2_6-Q4_K_M.gguf
13646+ files:
13647+ - filename: minicpm-o-2_6-Q4_K_M.gguf
13648+ sha256: 4f635fc0c0bb88d50ccd9cf1f1e5892b5cb085ff88fe0d8e1148fd9a8a836bc2
13649+ uri: huggingface://openbmb/MiniCPM-o-2_6-gguf/Model-7.6B-Q4_K_M.gguf
13650+ - filename: minicpm-o-2_6-mmproj-f16.gguf
13651+ sha256: efa4f7d96aa0f838f2023fc8d28e519179b16f1106777fa9280b32628191aa3e
13652+ uri: huggingface://openbmb/MiniCPM-o-2_6-gguf/mmproj-model-f16.gguf
13653+ - name: minicpm4_1-8b
13654+ url: github:mudler/LocalAI/gallery/chatml.yaml@master
13655+ urls:
13656+ - https://huggingface.co/openbmb/MiniCPM4.1-8B-GGUF
13657+ - https://huggingface.co/openbmb/MiniCPM4.1-8B
13658+ description: |
13659+ MiniCPM4.1-8B is an 8B-parameter language model with enhanced capabilities in coding, mathematics, and instruction following, building upon the MiniCPM4 architecture.
13660+ license: apache-2.0
13661+ icon: https://avatars.githubusercontent.com/u/89920203
13662+ tags:
13663+ - llm
13664+ - gguf
13665+ - gpu
13666+ - cpu
13667+ overrides:
13668+ parameters:
13669+ model: MiniCPM4.1-8B-Q4_K_M.gguf
13670+ files:
13671+ - filename: MiniCPM4.1-8B-Q4_K_M.gguf
13672+ sha256: 9d2ffb9145bf7a88ddb94b2542b42d925293666c42962aa158eeb62fc9708654
13673+ uri: huggingface://openbmb/MiniCPM4.1-8B-GGUF/MiniCPM4.1-8B-Q4_K_M.gguf
13674+ - name: minicpm4-8b
13675+ url: github:mudler/LocalAI/gallery/chatml.yaml@master
13676+ urls:
13677+ - https://huggingface.co/openbmb/MiniCPM4-8B-GGUF
13678+ - https://huggingface.co/openbmb/MiniCPM4-8B
13679+ description: |
13680+ MiniCPM4-8B is an 8B-parameter language model achieving competitive performance among models of similar size, with strong capabilities in reasoning, coding, and multilingual tasks.
13681+ license: apache-2.0
13682+ icon: https://avatars.githubusercontent.com/u/89920203
13683+ tags:
13684+ - llm
13685+ - gguf
13686+ - gpu
13687+ - cpu
13688+ overrides:
13689+ parameters:
13690+ model: MiniCPM4-8B-Q4_K_M.gguf
13691+ files:
13692+ - filename: MiniCPM4-8B-Q4_K_M.gguf
13693+ sha256: 80b99ec4ceac302e7d474c8659e96b9f6c3bbeb73c41b2ef841c7fcb6d8250f3
13694+ uri: huggingface://openbmb/MiniCPM4-8B-GGUF/MiniCPM4-8B-Q4_K_M.gguf
1347813695- name: aquif-ai_aquif-3.5-8b-think
1347913696 url: github:mudler/LocalAI/gallery/qwen3.yaml@master
1348013697 urls:
0 commit comments