Skip to content

Commit 6bd373c

Browse files
committed
address comments, update docs
1 parent 176e3ea commit 6bd373c

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

src/inference_endpoint/load_generator/scheduler.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -242,6 +242,7 @@ class Scheduler:
242242
Built-in schedulers:
243243
- MaxThroughputScheduler: Issues all queries immediately (offline mode)
244244
- PoissonDistributionScheduler: Poisson-distributed delays (online mode)
245+
- ConcurrencyScheduler: Fixed concurrency level (online mode)
245246
246247
Attributes:
247248
_IMPL_MAP: Class-level registry mapping LoadPatternType to Scheduler classes.

0 commit comments

Comments
 (0)