Skip to content

Commit 6e7b278

Browse files
fix(helm): restore TEI float16 dtype (#76)
1 parent 928c75e commit 6e7b278

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

charts/hub/values.yaml

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -155,7 +155,10 @@ embeddings:
155155
# When empty, the chart renders TEI args from model, servedModelName, port,
156156
# revision, and persistence.mountPath. Set this to fully override args.
157157
args: []
158-
extraArgs: []
158+
# Keeps the default GTE CPU runtime within the default memory budget.
159+
extraArgs:
160+
- --dtype
161+
- float16
159162
env: {}
160163

161164
port: 8080

0 commit comments

Comments
 (0)