|
1 | 1 | --- |
| 2 | +- name: "qwythos-9b-v2" |
| 3 | + url: "github:mudler/LocalAI/gallery/virtual.yaml@master" |
| 4 | + urls: |
| 5 | + - https://huggingface.co/empero-ai/Qwythos-9B-v2-GGUF |
| 6 | + description: | |
| 7 | + Empero AI |
| 8 | + |
| 9 | + # Qwythos-9B-v2 — the new and improved Qwythos |
| 10 | + |
| 11 | + The next iteration of Qwythos: **all the reasoning of Qwythos-9B, with the looping behavior fixed.** v2 keeps the deep chain-of-thought, the uncensored research posture, and the 1M-token context of its predecessor, and cleans up the rough edges that showed up in real use. |
| 12 | + |
| 13 | + - 🔁 **Looping behavior eliminated** — repetition/degeneration under greedy or low-temperature decoding dropped from **6.7% → 0%**. You can serve it *without* leaning on `repetition_penalty` as a band-aid. |
| 14 | + - 🧠 **Reasoning fully preserved** — MMLU, GSM8K, GPQA, ARC and HumanEval are all held at (or above) the v1 level. This is a *hygiene* upgrade, not a capability regression. |
| 15 | + - 🧩 **MTP head restored** — the native multi-token-prediction module (dropped in the previous export) is back, so config and weights agree and speculative-decoding setups work. |
| 16 | + - 🪪 **Cleaner identity** — the model no longer prefaces unrelated answers with its identity; it introduces itself only when you actually ask. |
| 17 | + - 🔓 **Still intentionally uncensored** for research, cybersecurity, red-teaming, biology, chemistry, pharmacology and clinical work. |
| 18 | + - 📜 **St |
| 19 | + |
| 20 | + ... |
| 21 | + license: "apache-2.0" |
| 22 | + tags: |
| 23 | + - llm |
| 24 | + - gguf |
| 25 | + - vision |
| 26 | + - multimodal |
| 27 | + - reasoning |
| 28 | + overrides: |
| 29 | + backend: llama-cpp |
| 30 | + function: |
| 31 | + automatic_tool_parsing_fallback: true |
| 32 | + grammar: |
| 33 | + disable: true |
| 34 | + known_usecases: |
| 35 | + - chat |
| 36 | + mmproj: llama-cpp/mmproj/Qwythos-9B-v2-MTP-Q4_K_M/mmproj-Qwythos-9B-v2-BF16.gguf |
| 37 | + options: |
| 38 | + - use_jinja:true |
| 39 | + - spec_type:draft-mtp |
| 40 | + - spec_n_max:6 |
| 41 | + - spec_p_min:0.75 |
| 42 | + parameters: |
| 43 | + model: llama-cpp/models/Qwythos-9B-v2-MTP-Q4_K_M/Qwythos-9B-v2-MTP-Q4_K_M.gguf |
| 44 | + template: |
| 45 | + use_tokenizer_template: true |
| 46 | + files: |
| 47 | + - filename: llama-cpp/models/Qwythos-9B-v2-MTP-Q4_K_M/Qwythos-9B-v2-MTP-Q4_K_M.gguf |
| 48 | + sha256: cfdd00ac1c1dc9ced33f23817fb4282f2594067e02e34d82e3e63bc0ea275b05 |
| 49 | + uri: https://huggingface.co/empero-ai/Qwythos-9B-v2-GGUF/resolve/main/Qwythos-9B-v2-MTP-Q4_K_M.gguf |
| 50 | + - filename: llama-cpp/mmproj/Qwythos-9B-v2-MTP-Q4_K_M/mmproj-Qwythos-9B-v2-BF16.gguf |
| 51 | + sha256: 0d1687cb33124c78acab788b342d4a2eaf85b3035e87c3abe4ee9d0b84ddb4f5 |
| 52 | + uri: https://huggingface.co/empero-ai/Qwythos-9B-v2-GGUF/resolve/main/mmproj-Qwythos-9B-v2-BF16.gguf |
2 | 53 | - name: "qwen3.6-27b-fable-fusion-711-uncensored-heretic-nm-dau-neo-max-mtp" |
3 | 54 | url: "github:mudler/LocalAI/gallery/virtual.yaml@master" |
4 | 55 | urls: |
|
0 commit comments