Skip to content

Commit adb39a5

Browse files
committed
feat(charts): Add vllm-omni container support in API deployment
Signed-off-by: Victor Hang <vhvictorhang@gmail.com>
1 parent 01d7427 commit adb39a5

1 file changed

Lines changed: 8 additions & 0 deletions

File tree

charts/azimuth-llm/templates/api/deployment.yml

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -26,13 +26,21 @@ spec:
2626
{{- else }}
2727
image: "{{ .Values.api.image.containerImage }}:{{ .Values.api.image.version }}"
2828
{{- end }}
29+
{{- if eq .Values.api.image.containerImage "vllm/vllm-omni" }}
30+
command:
31+
- vllm
32+
- serve
33+
{{- end }}
2934
ports:
3035
- name: api
3136
containerPort: 8000
3237
volumeMounts:
3338
- name: data
3439
mountPath: /root/.cache/huggingface
3540
args:
41+
{{- if eq .Values.api.image.containerImage "vllm/vllm-omni" }}
42+
- --omni
43+
{{- end }}
3644
{{- if semverCompare "<v0.13.0" .Values.api.image.version }}
3745
- --model
3846
{{- end }}

0 commit comments

Comments
 (0)