Skip to content

Commit 8cc7a94

Browse files
committed
Fix pre-commit
1 parent 3a922ad commit 8cc7a94

1 file changed

Lines changed: 0 additions & 1 deletion

File tree

docs/user_guide/ensemble_models.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -242,7 +242,6 @@ The optimal value depends on your specific deployment, including batch size, req
242242
no synchronization overhead is incurred.
243243
* **Minimal overhead when enabled**: Uses a blocking/wakeup mechanism per ensemble step, where upstream models are paused ("blocked") when the inflight requests limit is reached and resumed ("woken up") as downstream models complete processing them. This synchronization ensures memory usage stays within bounds, though it may increase latency.
244244

245-
246245
**Note**: This blocking does not cancel or internally time out intermediate requests, but clients may experience increased end-to-end latency.
247246

248247
## Additional Resources

0 commit comments

Comments
 (0)