Skip to content

Commit 530f590

Browse files
committed
fixed stream in example
1 parent 1527c3c commit 530f590

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

examples/containers/sglang_deployment_example.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -242,11 +242,11 @@ def graceful_shutdown(signum, frame) -> None:
242242
path="/v1/completions",
243243
)
244244
print("Completions API is working!")
245-
print(f"Response: {completions_response}")
245+
print(f"Response: {completions_response.output()}\n")
246246

247247
# Make a stream sync inference request to the SGLang server
248248
completions_response_stream = created_deployment.run_sync(
249-
completions_data,
249+
{**completions_data, "stream": True},
250250
path="/v1/completions",
251251
stream=True
252252
)

0 commit comments

Comments
 (0)