Deploy Open WebUI for offline/air-gapped environments with vLLM and RHOAI inference endpoints.
# Edit configmap.yaml for your environment, then apply it first
oc apply -f configmap.yaml
# Apply Namespace, PVC, Deployment, Service, and Route
oc apply -f open-webui.yamlOr use Kustomize:
oc apply -k .oc get pods -n open-webui
oc get route -n open-webui- Open the route URL
- Create admin account (first user becomes admin)
- Go to Admin Panel → Settings → Connections → OpenAI API
- Add your vLLM endpoint URL and API token
- Offline mode - No internet required, all external fetches disabled
- Server-side API - Connections made from pod (bypasses CORS)
- Self-signed certs - SSL verification disabled for OpenShift routes
- Persistent storage - User data stored on PVC
- Review
configmap.yamlbefore deployment and adjust it for your environment. - Change
WEBUI_SECRET_KEYinopen-webui.yamlbefore production use. - This manifest is intended for a single-replica deployment backed by local SQLite/Chroma data on the PVC.
- For multi-replica or multi-worker deployments, Open WebUI recommends moving to PostgreSQL and Redis: Scaling Open WebUI.
- Environment variable behavior and supported settings are documented in Environment Variable Configuration.
| File | Purpose |
|---|---|
open-webui.yaml |
Namespace, PVC, Deployment, Service, and Route in a single manifest |
configmap.yaml |
Feature toggles, API settings, and offline config |
kustomization.yaml |
Kustomize configuration for configmap.yaml and open-webui.yaml |
oc delete -k .