Skip to content

Increase batcher test timeout - #8656

Closed
mc-nv wants to merge 2 commits into
mainfrom
mchornyi/TRI-476/fix-batcher
Closed

Increase batcher test timeout#8656
mc-nv wants to merge 2 commits into
mainfrom
mchornyi/TRI-476/fix-batcher

Conversation

@mc-nv

@mc-nv mc-nv commented Feb 12, 2026

Copy link
Copy Markdown
Contributor

Updating timeout to support longer time for models workload.

@mc-nv mc-nv self-assigned this Feb 12, 2026
@mc-nv mc-nv changed the title Mchornyi/tri 476/fix batcher Increase batcher test timeout Feb 12, 2026
@mudit-eng

Copy link
Copy Markdown
Contributor

Does new timeout guarantee that tests would pass? How do we know there is not an underlying regression causing longer response time?

@mc-nv

mc-nv commented Feb 12, 2026

Copy link
Copy Markdown
Contributor Author

Does new timeout guarantee that tests would pass? How do we know there is not an underlying regression causing longer response time?

It's experimental result, currently we have a QA complain on failed test.
We can try to warm up the models before starting the server, it could speed up.
Indeed this change is questionable, but without submitting it we won't have a conversation about it.

@mc-nv
mc-nv marked this pull request as draft February 12, 2026 19:57
@mc-nv mc-nv closed this Feb 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants