fix(router): production-ready request router + auto-size batch for embedding/rerank - #10104

Merged

mudler merged 3 commits into

mudler:masterfrom

richiejp:fix/router-config

Jun 12, 2026

Commits on Jun 12, 2026

fix(router): score classifier production-readiness
richiejp
committed
feat(backend): auto-size batch to context for embedding and rerank models
richiejp
committed
fix(gallery): raise arch-router scoring output cap via parallel:64
richiejp
committed