File tree Expand file tree Collapse file tree
examples/runtime-free-router/sglang Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -41,6 +41,10 @@ kubectl create secret generic hf-token-secret \
4141 -n " ${NAMESPACE} "
4242```
4343
44+ Before applying, replace the ` my-registry/dynamo-select-service:my-tag `
45+ placeholder in ` kustomization.yaml ` with a Dynamo image that includes
46+ ` python -m dynamo.select_service ` .
47+
4448Apply the manifests and wait for the Pods:
4549
4650``` bash
Original file line number Diff line number Diff line change @@ -8,8 +8,9 @@ resources:
88 - sglang-worker.yaml
99images :
1010 - name : dynamo-image
11- newName : nvcr.io/nvidia/ai-dynamo/dynamo-frontend
12- newTag : 1.3.0-dev.1
11+ # Replace with a Dynamo image built with the select-service feature.
12+ newName : my-registry/dynamo-select-service
13+ newTag : my-tag
1314 - name : sglang-image
1415 newName : lmsysorg/sglang
1516 newTag : v0.5.12.post1
You can’t perform that action at this time.
0 commit comments