You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -180,7 +180,7 @@ guidellm run \
180
180
**Key parameters:**
181
181
182
182
-`--profile kind=<type>`: Defines the traffic pattern — `synchronous`, `concurrent`, `throughput`, `constant`, `poisson`, or `sweep`
183
-
-`--profile kind=constant,rate=10`: For `constant`/`poisson`, set requests per second in the profile config; for `concurrent`, use `streams=`; for `throughput`, use `max_concurrency=`. For `constant`, `poisson`, and `concurrent`, multiple rates can be specified as a JSON list (e.g., `rate=[1,5,10]`). Rates are sorted ascending, and if a failure constraint (over-saturation, errors) triggers at a given rate, remaining higher rates are skipped.
183
+
-`--profile kind=constant,rate=10`: For `constant`/`poisson`, set requests per second in the profile config; for `concurrent`, use `streams=`; for `throughput`, use `max_concurrency=`
184
184
-`--constraint kind=max_duration,seconds=<seconds>` or `--constraint kind=max_requests,count=<count>`: Limit each strategy by time or request count
Copy file name to clipboardExpand all lines: docs/getting-started/benchmark.md
+7-1Lines changed: 7 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -141,6 +141,8 @@ guidellm run --profile kind=concurrent,streams=10
141
141
|`rampup_duration`| Seconds to spread initial requests |`--profile kind=concurrent,streams=10,rampup_duration=10`|
142
142
|`max_concurrency`| Maximum concurrent requests to schedule |`--profile kind=concurrent,streams=10,max_concurrency=10`|
143
143
144
+
When multiple stream counts are specified, they are sorted in ascending order. If a failure constraint (such as over-saturation or excessive errors) triggers at a given stream count, all remaining higher stream counts are skipped.
145
+
144
146
#### Constant Profile
145
147
146
148
Sends asynchronous requests at a fixed rate per second.
@@ -157,6 +159,8 @@ guidellm run --profile '{"kind":"constant","rate":[16,32]}'
157
159
|`rampup_duration`| Seconds to linearly ramp from 0 to target rate |`--profile kind=constant,rate=10,rampup_duration=10`|
158
160
|`max_concurrency`| Maximum concurrent requests to schedule |`--profile kind=constant,rate=10,max_concurrency=32`|
159
161
162
+
When multiple rates are specified, they are sorted in ascending order. If a failure constraint (such as over-saturation or excessive errors) triggers at a given rate, all remaining higher rates are skipped.
163
+
160
164
#### Poisson Profile
161
165
162
166
Sends asynchronous requests at varying rates using a Poisson distribution around the specified target rate(s). This probabilistic pattern is useful for simulating more realistic real-world traffic patterns.
@@ -170,6 +174,8 @@ guidellm run --profile kind=poisson,rate=16 --seed kind=static,value=42
170
174
|`rate`| Target rate(s) in requests per second |`--profile kind=poisson,rate=10` or `--profile '{"kind":"poisson","rate":[10,20]}'`|
171
175
|`max_concurrency`| Maximum concurrent requests to schedule |`--profile kind=poisson,rate=10,max_concurrency=32`|
172
176
177
+
When multiple rates are specified, they are sorted in ascending order. If a failure constraint (such as over-saturation or excessive errors) triggers at a given rate, all remaining higher rates are skipped.
178
+
173
179
Use `--seed kind=static,value=42` for reproducible Poisson scheduling.
174
180
175
181
#### Sweep Profile
@@ -178,7 +184,7 @@ The sweep profile applies a sequence of benchmark strategies to find the optimal
178
184
179
185
1. It runs a `synchronous` strategy to measure the baseline rate,
180
186
2. then runs a `throughput` strategy to determine peak throughput,
181
-
3. and finally runs a series of asynchronous strategies with rates interpolated between the baseline and maximum throughput. (The number of interpolated strategies is `sweep_size` minus 2.) The asynchronous strategy type is determined by the `strategy_type` profile parameter. The default strategy type is `constant`.
187
+
3. and finally runs a series of asynchronous strategies with rates interpolated between the baseline and maximum throughput. (The number of interpolated strategies is `sweep_size` minus 2.) The asynchronous strategy type is determined by the `strategy_type` profile parameter. The default strategy type is `constant`. During the async phase, if a failure constraint triggers at a given rate, all remaining higher rates are skipped.
182
188
183
189
For example, to run a sweep with 10 strategies, 10 seconds of rampup, and a strategy type of `poisson`:
0 commit comments