Skip to content

Commit e046a77

Browse files
localai-botmudler
andauthored
chore(model gallery): 🤖 add 1 new models via gallery agent (#10328)
chore(model gallery): 🤖 add new models via gallery agent Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
1 parent e5c95e0 commit e046a77

1 file changed

Lines changed: 49 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 49 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,53 @@
11
---
2+
- name: "gemma-4-12b-coder-fable5-composer2.5-v1"
3+
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
4+
urls:
5+
- https://huggingface.co/yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF
6+
description: |
7+
Hugging Face |
8+
GitHub |
9+
Launch Blog |
10+
Documentation
11+
12+
License: Apache 2.0 | Authors: Google DeepMind
13+
14+
> [!Note]
15+
> This model card is for the Gemma 4 12B Unified model, which is part of the Gemma 4 family of open models. Built with the same multimodal functionality as Gemma 4 E2B and E4B (text, audio, image, and video inputs), it brings native audio and vision understanding directly to local environments without the need for separate encoders. This unified approach to multimodality makes the model encoder-free, offering a deployment size that is perfect for consumer devices and streamlined local execution.
16+
17+
Gemma is a family of open models built by Google DeepMind. Gemma 4 models are multimodal, handling text and image input (with audio supported on E2B, E4B, and 12B) and generating text output. This release includes open-weights models in both pre-trained and instruction-tuned variants. Gemma 4 features a context window of up to 256K tokens and maintains multilingual support in over 140 languages.
18+
19+
...
20+
license: "gemma"
21+
tags:
22+
- llm
23+
- gguf
24+
- code
25+
- reasoning
26+
- thinking
27+
icon: https://ai.google.dev/gemma/images/gemma4_banner.png
28+
overrides:
29+
backend: llama-cpp
30+
function:
31+
automatic_tool_parsing_fallback: true
32+
grammar:
33+
disable: true
34+
known_usecases:
35+
- chat
36+
options:
37+
- use_jinja:true
38+
parameters:
39+
min_p: 0
40+
model: llama-cpp/models/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF/gemma4-coding-Q4_K_M.gguf
41+
repeat_penalty: 1
42+
temperature: 1
43+
top_k: 64
44+
top_p: 0.95
45+
template:
46+
use_tokenizer_template: true
47+
files:
48+
- filename: llama-cpp/models/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF/gemma4-coding-Q4_K_M.gguf
49+
sha256: 4011bb86572a587783a553b54927314a2ed8395befa59db202ee775d183cd751
50+
uri: https://huggingface.co/yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF/resolve/main/gemma4-coding-Q4_K_M.gguf
251
- name: "serenity-26b-a4b"
352
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
453
urls:

0 commit comments

Comments
 (0)