Skip to content

gallery: add Qwythos 27B variants - #11292

Open
localai-org-maint-bot wants to merge 1 commit into
masterfrom
cron/model-gallery-20260802-run1
Open

gallery: add Qwythos 27B variants#11292
localai-org-maint-bot wants to merge 1 commit into
masterfrom
cron/model-gallery-20260802-run1

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Summary

  • add Qwythos-27B-v1 using the recommended Q4_K_M GGUF and shared vision projector
  • add an MTP-enabled Q4_K_M variant so LocalAI can prefer speculative decoding where supported
  • tag the existing Qwythos-9B-v2 MTP configuration for correct serving-feature ranking

Verification

  • go test ./core/gallery -ginkgo.focus='gallery/index.yaml variant invariants|keeps every entry that declares variants installable'
  • git diff --check https-origin/master...HEAD
  • independently matched all three declared SHA256 values against Hugging Face x-linked-etag headers

The full go test ./core/gallery run reached 324 passing specs but had 3 unrelated network-dependent failures because raw GitHub/gist requests returned HTTP 403 in the cron environment.

Assisted-by: Codex:gpt-5

Add the recommended Q4_K_M build and an MTP-enabled variant with the shared vision projector. Tag the existing Qwythos 9B MTP entry so serving-feature ranking recognizes it.

Assisted-by: Codex:gpt-5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant