@@ -119,8 +119,15 @@ Before you begin, ensure you have the following installed:
119119### Required API Configuration
120120
121121** For Inference Service (Code Translation):**
122- - INFERENCE_API_ENDPOINT: URL of the deployed model inference service
123- - INFERENCE_API_TOKEN: API key / bearer token used to authenticate requests
122+
123+ This application supports multiple inference deployment patterns:
124+
125+ - ** GenAI Gateway** : Intel's centralized gateway for multi-model access
126+ - ** APISIX Gateway** : API gateway with routing and authentication
127+
128+ Configuration requirements:
129+ - INFERENCE_API_ENDPOINT: URL to your inference service (GenAI Gateway, APISIX Gateway, etc.)
130+ - INFERENCE_API_TOKEN: Authentication token/API key for your chosen service
124131
125132### Verify Docker Installation
126133
@@ -156,6 +163,13 @@ cat > .env << EOF
156163BACKEND_PORT=5001
157164
158165# Inference API Configuration
166+ # INFERENCE_API_ENDPOINT: URL to your inference service (without /v1 suffix)
167+ # - For GenAI Gateway: https://genai-gateway.example.com
168+ # - For APISIX Gateway: https://apisix-gateway.example.com/inference
169+ #
170+ # INFERENCE_API_TOKEN: Authentication token/API key for the inference service
171+ # - For GenAI Gateway: Your GenAI Gateway API key
172+ # - For APISIX Gateway: Your APISIX authentication token
159173INFERENCE_API_ENDPOINT=https://your-api-endpoint.com/deployment
160174INFERENCE_API_TOKEN=your-pre-generated-token-here
161175INFERENCE_MODEL_NAME=codellama/CodeLlama-34b-Instruct-hf
@@ -180,6 +194,13 @@ Or manually create `.env` with:
180194BACKEND_PORT=5001
181195
182196# Inference API Configuration
197+ # INFERENCE_API_ENDPOINT: URL to your inference service (without /v1 suffix)
198+ # - For GenAI Gateway: https://genai-gateway.example.com
199+ # - For APISIX Gateway: https://apisix-gateway.example.com/inference
200+ #
201+ # INFERENCE_API_TOKEN: Authentication token/API key for the inference service
202+ # - For GenAI Gateway: Your GenAI Gateway API key
203+ # - For APISIX Gateway: Your APISIX authentication token
183204INFERENCE_API_ENDPOINT=https://your-api-endpoint.com/deployment
184205INFERENCE_API_TOKEN=your-pre-generated-token-here
185206INFERENCE_MODEL_NAME=codellama/CodeLlama-34b-Instruct-hf
0 commit comments