You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When models are deployed on a remote server, a base URL and an API key are required to access them. To set up a remote server and acquire the base URL and API key, refer to [Intel® AI for Enterprise Inference](https://www.intel.com/content/www/us/en/developer/topic-technology/artificial-intelligence/enterprise-inference.html) offerings.
@@ -159,7 +159,7 @@ Different Docker Compose files (`compose.yaml`, `compose_tgi.yaml`) control whic
159
159
If you need to modify the microservices:
160
160
161
161
1. Clone the [OPEA GenAIComps](https://github.com/opea-project/GenAIComps) repository.
162
-
2. Follow build instructions in the respective component directories (e.g., `comps/llms/text-generation`, `comps/codegen`, `comps/ui/gradio`, etc.). Use the provided Dockerfiles (e.g., `CodeGen/Dockerfile`, `CodeGen/ui/docker/Dockerfile.gradio`).
162
+
2. Follow build instructions in the respective component directories (e.g., `comps/llms/text-generation`, `comps/codegen`, etc.). Use the provided Dockerfiles (e.g., `CodeGen/Dockerfile`, `CodeGen/ui/docker/Dockerfile`).
163
163
3. Tag your custom images appropriately (e.g., `my-custom-codegen:latest`).
164
164
4. Update the `image:` fields in the compose files (`compose.yaml` or `compose_tgi.yaml`) to use your custom image tags.
165
165
@@ -207,18 +207,17 @@ Use `curl` commands to test the main service endpoints. Ensure `HOST_IP` is corr
207
207
208
208
Multiple UI options can be configured via the compose files.
209
209
210
-
### Gradio UI (Default)
210
+
### Svelte UI (Default)
211
211
212
-
Access the default Gradio UI by navigating to:
212
+
Access the default Svelte UI by navigating to:
213
213
`http://{HOST_IP}:5173`
214
-
_(Port `5173` is the default host mapping for `codegen-gradio-ui-server`)_
214
+
_(Port `5173` is the default host mapping for `codegen-ui-server`)_
1. Modify the compose file (either `compose.yaml` or `compose_tgi.yaml`): Comment out the `codegen-gradio-ui-server` service and uncomment/add the `codegen-xeon-ui-server` (Svelte) service definition, ensuring the port mapping is correct (e.g., `"- 5173:5173"`).
220
+
1. Modify the compose file (either `compose.yaml` or `compose_tgi.yaml`): Comment out the `codegen-xeon-ui-server` (Svelte) service and uncomment/add the `codegen-gradio-ui-server` service definition, ensuring the port mapping is correct (e.g., `"- 5173:5173"`).
222
221
2. Restart Docker Compose: `docker compose up -d` or `docker compose -f compose_tgi.yaml up -d`
223
222
3. Access: `http://{HOST_IP}:5173` (or the host port you mapped).
1. Modify the compose file (either `compose.yaml` or `compose_tgi.yaml`): Swap Gradio service forSvelte (`codegen-gaudi-ui-server`), check port map (e.g., `5173:5173`).
210
+
1. Modify the compose file (either `compose.yaml` or `compose_tgi.yaml`): Swap Svelte service forGradio (`codegen-gradio-ui-server`), check port map (e.g., `5173:5173`).
211
211
2. Restart: `docker compose up -d` or `docker compose -f compose_tgi.yaml up -d`
212
212
3. Access: `http://{HOST_IP}:5173`
213
213
214
214
### React UI (Optional)
215
215
216
-
1. Modify the compose file (either `compose.yaml` or `compose_tgi.yaml`): Swap Gradio service for React (`codegen-gaudi-react-ui-server`), check port map (e.g., `5174:80`).
216
+
1. Modify the compose file (either `compose.yaml` or `compose_tgi.yaml`): Swap Svelte service for React (`codegen-gaudi-react-ui-server`), check port map (e.g., `5174:80`).
217
217
2. Restart: `docker compose up -d` or `docker compose -f compose_tgi.yaml up -d`
0 commit comments