Skip to content

Commit c82b166

Browse files
authored
Fix test non-determinism: (#52)
The probe command truncates the responses to the probe requests and only keeps the first 10 responses. This can cause test failures as the responses are out of order and particularly in CI the probe-0 would be missing in the first 10 requests. The fix is to not truncate the responses which can be verbose but it prevents failures such as this one from creeping. Signed-off-by: Rashid Kaleem <230885705+arekay-nv@users.noreply.github.com>
1 parent 9a7cdbe commit c82b166

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

src/inference_endpoint/commands/probe.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -202,8 +202,8 @@ async def run_probe_command(args: argparse.Namespace) -> None:
202202
# Show sample responses for sanity check
203203
if responses:
204204
logger.info(f"✓ Sample responses ({len(responses)} collected):")
205-
# Show first 10 responses
206-
for query_id, response in responses[:10]:
205+
# Show all responses - can be overwhelming, but useful for debugging
206+
for query_id, response in responses:
207207
# Truncate long responses
208208
response_preview = (
209209
response[:100] + "..." if len(response) > 100 else response

0 commit comments

Comments
 (0)