Skip to content

Commit 806461e

Browse files
author
Harika
committed
updating llama 3.1 8b instruct deployment.md
1 parent 9e3c97d commit 806461e

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

  • third_party/Dell/model-deployment/llama-3.1-8b-instruct

third_party/Dell/model-deployment/llama-3.1-8b-instruct/deployment.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
## Step 1: Prerequisites to Deploy Llama-3.1-8B-Instruct Model on Gaudi with Keycloak
1+
## Step 1: Prerequisites to Deploy Llama-3.1-8B-Instruct Model on Xeon with Keycloak
22

33
Ensure the Enterprise Inference stack with Keycloak is already deployed before proceeding.
44

@@ -26,7 +26,7 @@ This exports: `BASE_URL`, `KEYCLOAK_CLIENT_ID`, `KEYCLOAK_CLIENT_SECRET`, and `T
2626

2727
```bash
2828
helm install vllm-llama-8b ./core/helm-charts/vllm \
29-
--values ./core/helm-charts/vllm/gaudi3-values.yaml \
29+
--values ./core/helm-charts/vllm/xeon-values.yaml \
3030
--set LLM_MODEL_ID="meta-llama/Llama-3.1-8B-Instruct" \
3131
--set global.HUGGINGFACEHUB_API_TOKEN="$HUGGING_FACE_HUB_TOKEN" \
3232
--set ingress.enabled=true \

0 commit comments

Comments
 (0)