You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/content/features/distributed-mode.md
-23Lines changed: 0 additions & 23 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -15,29 +15,6 @@ Distributed mode requires authentication enabled with a **PostgreSQL** database
15
15
16
16

17
17
18
-
```
19
-
┌─────────────────┐
20
-
│ Load Balancer │
21
-
└────────┬────────┘
22
-
│
23
-
┌──────────────┼──────────────┐
24
-
│ │ │
25
-
┌───────▼──────┐ ┌────▼─────┐ ┌─────▼──────┐
26
-
│ Frontend #1 │ │ Frontend │ │ Frontend #N│
27
-
│ (LocalAI) │ │ #2 │ │ (LocalAI) │
28
-
└──────┬───────┘ └────┬─────┘ └─────┬──────┘
29
-
│ │ │
30
-
┌───────▼──────────────▼──────────────▼───────┐
31
-
│ PostgreSQL + NATS │
32
-
│ (node registry, jobs, coordination) │
33
-
└───────┬──────────────┬──────────────┬───────┘
34
-
│ │ │
35
-
┌──────▼──────┐ ┌────▼─────┐ ┌─────▼──────┐
36
-
│ Worker #1 │ │ Worker │ │ Worker #N │
37
-
│ (generic) │ │ #2 │ │ (generic) │
38
-
└─────────────┘ └──────────┘ └────────────┘
39
-
```
40
-
41
18
**Frontends** are stateless LocalAI instances that receive API requests and route them to worker nodes via the **SmartRouter**. All frontends share state through PostgreSQL and coordinate via NATS.
42
19
43
20
**Workers** are generic processes that self-register with a frontend. They don't have a fixed backend type — the SmartRouter dynamically installs the required backend via NATS `backend.install` events when a model request arrives.
0 commit comments