@@ -14,7 +14,7 @@ that together caused 7 of 17 services to be unavailable or broken.
1414
1515### Bug Class 1 — SSO Redirect URI Mismatch (LibreChat / serverclaw client)
1616
17- When a user clicked "Login with Keycloak" on LibreChat (` chat.lv3.org ` ), Keycloak returned:
17+ When a user clicked "Login with Keycloak" on LibreChat (` chat.example.com ` ), Keycloak returned:
1818
1919```
2020We are sorry... An internal server error has occurred
@@ -53,22 +53,22 @@ play time, causing template rendering to silently fail or produce empty port num
5353
5454| Service | URL | Symptom | Broken variable |
5555| ---------| -----| ---------| ----------------|
56- | Directus | data.lv3.org | 502 Bad Gateway | ` directus_container_port ` |
57- | Paperless | paperless.lv3.org | 502 Bad Gateway | ` paperless_service_topology ` |
58- | Coolify | coolify.lv3.org | 502 Bad Gateway | ` coolify_dashboard_port ` |
59- | GlitchTip | errors.lv3.org | TLS + dead code | ` glitchtip_internal_port ` (dead code) |
56+ | Directus | data.example.com | 502 Bad Gateway | ` directus_container_port ` |
57+ | Paperless | paperless.example.com | 502 Bad Gateway | ` paperless_service_topology ` |
58+ | Coolify | coolify.example.com | 502 Bad Gateway | ` coolify_dashboard_port ` |
59+ | GlitchTip | errors.example.com | TLS + dead code | ` glitchtip_internal_port ` (dead code) |
6060
6161** Services with latent bugs (currently alive from old deployment):**
6262
6363| Service | URL | Broken variable | Risk |
6464| ---------| -----| ----------------| ------|
65- | Dify | agents.lv3.org | ` dify_port ` , ` dify_internal_base_url ` , ` dify_ollama_base_url ` | Next converge would break port mapping |
65+ | Dify | agents.example.com | ` dify_port ` , ` dify_internal_base_url ` , ` dify_ollama_base_url ` | Next converge would break port mapping |
6666
6767** Services with TLS cert gaps (separate from above):**
6868
6969The nginx edge certificate ` lv3-edge ` was missing SANs for five subdomains that were
7070added to the service topology after the last cert issuance:
71- ` grist.lv3.org ` , ` errors.lv3.org ` , ` bi.lv3.org ` , ` paperless.lv3.org ` , ` scheduler.lv3.org ` .
71+ ` grist.example.com ` , ` errors.example.com ` , ` bi.example.com ` , ` paperless.example.com ` , ` scheduler.example.com ` .
7272
7373This causes hard TLS errors in browsers even when the backend containers are running.
7474Fix: run ` make converge-nginx-edge env=production ` which will invoke certbot DNS-01
@@ -86,7 +86,7 @@ All other references (Keycloak client registration, service registry, tests)
8686must match this value. The path ` /oauth/openid/callback ` is correct.
8787
8888** Immediate live fix:** Updated the Keycloak ` serverclaw ` client via the admin API
89- on the live platform to register ` https://chat.lv3.org /oauth/openid/callback ` .
89+ on the live platform to register ` https://chat.example.com /oauth/openid/callback ` .
9090This fix is reflected in code so the next ` make converge-keycloak ` is idempotent.
9191
9292### 2. Eliminate all ` platform_service_topology ` references in role defaults
@@ -119,10 +119,10 @@ per ADR 0412).
119119| Action | Command | Required for |
120120| --------| ---------| --------------|
121121| Reissue TLS cert | ` make converge-nginx-edge env=production ` | grist, errors, bi, paperless, scheduler TLS |
122- | Redeploy Directus | ` make converge-directus env=production ` | data.lv3.org 502 fix |
123- | Redeploy Paperless | ` make converge-paperless env=production ` | paperless.lv3.org 502 fix |
124- | Redeploy Coolify | ` make converge-coolify env=production ` | coolify.lv3.org 502 fix |
125- | Investigate Superset | SSH to docker-runtime, `docker ps | grep superset` | bi.lv3.org — port chain correct, container may be stopped |
122+ | Redeploy Directus | ` make converge-directus env=production ` | data.example.com 502 fix |
123+ | Redeploy Paperless | ` make converge-paperless env=production ` | paperless.example.com 502 fix |
124+ | Redeploy Coolify | ` make converge-coolify env=production ` | coolify.example.com 502 fix |
125+ | Investigate Superset | SSH to docker-runtime, `docker ps | grep superset` | bi.example.com — port chain correct, container may be stopped |
126126| Re-converge Keycloak | ` make converge-keycloak env=production ` | Pick up serverclaw redirect_uri fix |
127127
128128---
@@ -142,7 +142,7 @@ per ADR 0412).
142142- Four services (Directus, Paperless, Coolify, Superset) require a manual re-convergence
143143 to actually recover from 502. The code fix alone is not sufficient.
144144- TLS cert expansion also requires a manual ` make converge-nginx-edge ` run.
145- - Nomad scheduler (` scheduler.lv3.org ` ) has both a TLS cert gap and a backend timeout
145+ - Nomad scheduler (` scheduler.example.com ` ) has both a TLS cert gap and a backend timeout
146146 and requires separate investigation.
147147
148148### Neutral
0 commit comments