We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 176e3ea commit 6bd373cCopy full SHA for 6bd373c
1 file changed
src/inference_endpoint/load_generator/scheduler.py
@@ -242,6 +242,7 @@ class Scheduler:
242
Built-in schedulers:
243
- MaxThroughputScheduler: Issues all queries immediately (offline mode)
244
- PoissonDistributionScheduler: Poisson-distributed delays (online mode)
245
+ - ConcurrencyScheduler: Fixed concurrency level (online mode)
246
247
Attributes:
248
_IMPL_MAP: Class-level registry mapping LoadPatternType to Scheduler classes.
0 commit comments