feat: smart federation routing (load + VRAM + model + prefix affinity + cross-server sync) and unified Cluster UI - #10124

Open

localai-bot wants to merge 16 commits into

masterfrom

feat/p2p-federation-clusterrouting

Commits on Jul 31, 2026

feat(p2p): gossip free VRAM per node and add testable online check

mudler
authored and
localai-org-maint-bot
committed
feat(p2p): route federation with shared clusterrouting policy (load + VRAM)

mudler
authored and
localai-org-maint-bot
committed
feat(routing): add load-guarded PickWithAffinity for prefix-cache routing

mudler
authored and
localai-org-maint-bot
committed
feat(p2p): gossip each peer's model set for model-aware federation

mudler
authored and
localai-org-maint-bot
committed
feat(p2p): model-filtered federation candidates and request model extraction

mudler
authored and
localai-org-maint-bot
committed
feat(p2p): affinity-aware peer selection and federation body-limit flag

mudler
authored and
localai-org-maint-bot
committed
feat(p2p): L7 HTTP-terminating federation proxy with model + prefix-affinity routing

mudler
authored and
localai-org-maint-bot
committed
refactor(p2p): dedupe forwarded Connection header and drop unused extractModel param

mudler
authored and
localai-org-maint-bot
committed
feat(p2p): edgevpn generic-channel publisher and handler for affinity sync

mudler
authored and
localai-org-maint-bot
committed
feat(p2p): optional cross-server prefix-affinity sync over the generic channel

mudler
authored and
localai-org-maint-bot
committed
feat(ui): add useP2PMode hook and embedded prop to Nodes and P2P pages

mudler
authored and
localai-org-maint-bot
committed
feat(ui): add Cluster page composing distributed and swarm sections

mudler
authored and
localai-org-maint-bot
committed
feat(ui): route /app/cluster, redirect /app/p2p and /app/nodes, single sidebar entry

mudler
authored and
localai-org-maint-bot
committed
refactor(ui): repoint internal links from /app/nodes to /app/cluster

mudler
authored and
localai-org-maint-bot
committed
test(ui): e2e specs for merged Cluster page and old-route redirects

mudler
authored and
localai-org-maint-bot
committed
test(ui): repoint page-render-smoke from /app/nodes to /app/cluster

mudler
authored and
localai-org-maint-bot
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat: smart federation routing (load + VRAM + model + prefix affinity + cross-server sync) and unified Cluster UI - #10124

feat: smart federation routing (load + VRAM + model + prefix affinity + cross-server sync) and unified Cluster UI#10124
localai-bot wants to merge 16 commits into
masterfrom
feat/p2p-federation-clusterrouting

Commits on Jul 31, 2026

feat(p2p): gossip free VRAM per node and add testable online check

feat(p2p): route federation with shared clusterrouting policy (load + VRAM)

feat(routing): add load-guarded PickWithAffinity for prefix-cache routing

feat(p2p): gossip each peer's model set for model-aware federation

feat(p2p): model-filtered federation candidates and request model extraction

feat(p2p): affinity-aware peer selection and federation body-limit flag

feat(p2p): L7 HTTP-terminating federation proxy with model + prefix-affinity routing

refactor(p2p): dedupe forwarded Connection header and drop unused extractModel param

feat(p2p): edgevpn generic-channel publisher and handler for affinity sync

feat(p2p): optional cross-server prefix-affinity sync over the generic channel

feat(ui): add useP2PMode hook and embedded prop to Nodes and P2P pages

feat(ui): add Cluster page composing distributed and swarm sections

feat(ui): route /app/cluster, redirect /app/p2p and /app/nodes, single sidebar entry

refactor(ui): repoint internal links from /app/nodes to /app/cluster

test(ui): e2e specs for merged Cluster page and old-route redirects

test(ui): repoint page-render-smoke from /app/nodes to /app/cluster