Skip to content

Commit bb4f559

Browse files
are-cesclaude
andcommitted
LCORE-2860: parametrize model name via vllm-model-secret
Create vllm-model-secret from MODEL_NAME in pipeline.sh so both llama-stack and lightspeed-stack pods read the model from a single source instead of hardcoding it. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent 89115a7 commit bb4f559

3 files changed

Lines changed: 6 additions & 2 deletions

File tree

tests/e2e-prow/rhoai/manifests/lightspeed/llama-stack-prow.yaml

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -102,7 +102,10 @@ spec:
102102
name: vllm-api-key-secret
103103
key: key
104104
- name: INFERENCE_MODEL
105-
value: "meta-llama/Llama-3.1-8B-Instruct"
105+
valueFrom:
106+
secretKeyRef:
107+
name: vllm-model-secret
108+
key: key
106109
- name: OPENAI_API_KEY
107110
valueFrom:
108111
secretKeyRef:

tests/e2e-prow/rhoai/pipeline.sh

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -64,6 +64,7 @@ create_secret() {
6464
create_secret hf-token-secret --from-literal=token="$HUGGING_FACE_HUB_TOKEN"
6565
create_secret vllm-api-key-secret --from-literal=key="$VLLM_API_KEY"
6666
create_secret openai-api-key-secret --from-literal=key=""
67+
create_secret vllm-model-secret --from-literal=key="$MODEL_NAME"
6768

6869
# MCP token secrets for lightspeed-stack
6970
REPO_ROOT="$(cd "$PIPELINE_DIR/../../.." && pwd)"

tests/e2e/configuration/server-mode/lightspeed-stack-rhoai.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ authentication:
2020
module: "noop"
2121
inference:
2222
default_provider: vllm
23-
default_model: ${env.INFERENCE_MODEL}
23+
default_model: ${env.VLLM_MODEL}
2424
byok_rag:
2525
- rag_id: e2e-test-docs
2626
rag_type: inline::faiss

0 commit comments

Comments
 (0)