Skip to content

Commit a867e2b

Browse files
authored
hotfix(chart): restore LLM_ROUTER_ARCH_BASE_URL tombstone to fix Omni during rollout (#2279)
hotfix(chart): restore LLM_ROUTER_ARCH_BASE_URL tombstone After #2265 merged, Omni disappeared from the model list in prod. Likely cause: the configmap rolled out before every replica was on the new image. The pre-#2265 code gated the Omni alias on LLM_ROUTER_ARCH_BASE_URL, so stripping the var left old pods without the alias. Add it back as a tombstone — new code ignores it, old code is happy. Safe to remove once every replica is on the new image.
1 parent 9e5c66d commit a867e2b

2 files changed

Lines changed: 8 additions & 0 deletions

File tree

chart/env/dev.yaml

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -61,6 +61,10 @@ envVars:
6161
PUBLIC_PLAUSIBLE_SCRIPT_URL: "https://plausible.io/js/pa-Io_oigECawqdlgpf5qvHb.js"
6262

6363
TASK_MODEL: "meta-llama/Llama-3.1-8B-Instruct"
64+
# Tombstone: unread by current code, kept so any old pod still on the pre-#2265
65+
# image (which gated Omni on LLM_ROUTER_ARCH_BASE_URL) keeps registering the alias
66+
# during rollout. Safe to remove once every replica is on the new image.
67+
LLM_ROUTER_ARCH_BASE_URL: "https://router.huggingface.co/v1"
6468
LLM_ROUTER_ROUTES_PATH: "build/client/chat/huggingchat/routes.chat.json"
6569
LLM_ROUTER_ENABLE_MULTIMODAL: "true"
6670
LLM_ROUTER_MULTIMODAL_MODEL: "moonshotai/Kimi-K2.6"

chart/env/prod.yaml

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -71,6 +71,10 @@ envVars:
7171
PUBLIC_PLAUSIBLE_SCRIPT_URL: "https://plausible.io/js/pa-Io_oigECawqdlgpf5qvHb.js"
7272

7373
TASK_MODEL: "meta-llama/Llama-3.1-8B-Instruct"
74+
# Tombstone: unread by current code, kept so any old pod still on the pre-#2265
75+
# image (which gated Omni on LLM_ROUTER_ARCH_BASE_URL) keeps registering the alias
76+
# during rollout. Safe to remove once every replica is on the new image.
77+
LLM_ROUTER_ARCH_BASE_URL: "https://router.huggingface.co/v1"
7478
LLM_ROUTER_ROUTES_PATH: "build/client/chat/huggingchat/routes.chat.json"
7579
LLM_ROUTER_ENABLE_MULTIMODAL: "true"
7680
LLM_ROUTER_MULTIMODAL_MODEL: "moonshotai/Kimi-K2.6"

0 commit comments

Comments
 (0)