Skip to content

Commit 1618c2e

Browse files
localai-botmudler
andauthored
chore(model gallery): 🤖 add 1 new models via gallery agent (#10971)
chore(model gallery): 🤖 add new models via gallery agent Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
1 parent 9043cbc commit 1618c2e

1 file changed

Lines changed: 51 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 51 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,55 @@
11
---
2+
- name: "qwythos-9b-v2"
3+
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
4+
urls:
5+
- https://huggingface.co/empero-ai/Qwythos-9B-v2-GGUF
6+
description: |
7+
Empero AI
8+
9+
# Qwythos-9B-v2 — the new and improved Qwythos
10+
11+
The next iteration of Qwythos: **all the reasoning of Qwythos-9B, with the looping behavior fixed.** v2 keeps the deep chain-of-thought, the uncensored research posture, and the 1M-token context of its predecessor, and cleans up the rough edges that showed up in real use.
12+
13+
- 🔁 **Looping behavior eliminated** — repetition/degeneration under greedy or low-temperature decoding dropped from **6.7% → 0%**. You can serve it *without* leaning on `repetition_penalty` as a band-aid.
14+
- 🧠 **Reasoning fully preserved** — MMLU, GSM8K, GPQA, ARC and HumanEval are all held at (or above) the v1 level. This is a *hygiene* upgrade, not a capability regression.
15+
- 🧩 **MTP head restored** — the native multi-token-prediction module (dropped in the previous export) is back, so config and weights agree and speculative-decoding setups work.
16+
- 🪪 **Cleaner identity** — the model no longer prefaces unrelated answers with its identity; it introduces itself only when you actually ask.
17+
- 🔓 **Still intentionally uncensored** for research, cybersecurity, red-teaming, biology, chemistry, pharmacology and clinical work.
18+
- 📜 **St
19+
20+
...
21+
license: "apache-2.0"
22+
tags:
23+
- llm
24+
- gguf
25+
- vision
26+
- multimodal
27+
- reasoning
28+
overrides:
29+
backend: llama-cpp
30+
function:
31+
automatic_tool_parsing_fallback: true
32+
grammar:
33+
disable: true
34+
known_usecases:
35+
- chat
36+
mmproj: llama-cpp/mmproj/Qwythos-9B-v2-MTP-Q4_K_M/mmproj-Qwythos-9B-v2-BF16.gguf
37+
options:
38+
- use_jinja:true
39+
- spec_type:draft-mtp
40+
- spec_n_max:6
41+
- spec_p_min:0.75
42+
parameters:
43+
model: llama-cpp/models/Qwythos-9B-v2-MTP-Q4_K_M/Qwythos-9B-v2-MTP-Q4_K_M.gguf
44+
template:
45+
use_tokenizer_template: true
46+
files:
47+
- filename: llama-cpp/models/Qwythos-9B-v2-MTP-Q4_K_M/Qwythos-9B-v2-MTP-Q4_K_M.gguf
48+
sha256: cfdd00ac1c1dc9ced33f23817fb4282f2594067e02e34d82e3e63bc0ea275b05
49+
uri: https://huggingface.co/empero-ai/Qwythos-9B-v2-GGUF/resolve/main/Qwythos-9B-v2-MTP-Q4_K_M.gguf
50+
- filename: llama-cpp/mmproj/Qwythos-9B-v2-MTP-Q4_K_M/mmproj-Qwythos-9B-v2-BF16.gguf
51+
sha256: 0d1687cb33124c78acab788b342d4a2eaf85b3035e87c3abe4ee9d0b84ddb4f5
52+
uri: https://huggingface.co/empero-ai/Qwythos-9B-v2-GGUF/resolve/main/mmproj-Qwythos-9B-v2-BF16.gguf
253
- name: "qwen3.6-27b-fable-fusion-711-uncensored-heretic-nm-dau-neo-max-mtp"
354
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
455
urls:

0 commit comments

Comments
 (0)