Skip to content

feat: add per-lane request budgets to agentic cache warmup - #26

Open
cquil11 wants to merge 1 commit into
cquil11/aiperf-agentx-v1.0from
cquil11/deterministic-agentic-warmup-count
Open

feat: add per-lane request budgets to agentic cache warmup#26
cquil11 wants to merge 1 commit into
cquil11/aiperf-agentx-v1.0from
cquil11/deterministic-agentic-warmup-count

Conversation

@cquil11

@cquil11 cquil11 commented Jul 29, 2026

Copy link
Copy Markdown

What

  • add --warmup-requests-per-lane as a deterministic alternative to --agentic-cache-warmup-duration
  • reject configurations that supply both options
  • enforce the count budget independently at each agentic replay lane, including roots, continuations, joins, and DAG children
  • keep a global requests_per_lane × active_lanes request cap as a zero-overshoot backstop
  • preserve replay-barrier and recycled-root state at the count boundary for the warmup-to-profiling handoff
  • retain the existing duration-only path unchanged
  • regenerate CLI docs and the YAML config schema

Why

Duration-only cache-pressure warmup makes request depth depend on server speed. The same C1 workload sent 670 warmup requests in one run and 343 in another, advancing the live conversation cursors by different amounts before profiling. A strict per-lane request budget makes the warmup depth stable across runs instead of letting faster lanes consume a shared global budget.

Example: --concurrency 16 --warmup-requests-per-lane 10 sends exactly 10 warmup requests on each lane (160 total). Use --agentic-cache-warmup-duration 600 instead when a time-bounded warmup is desired; the two options are mutually exclusive.

Validation

  • focused config, timing, strategy, CLI override, and orchestration suites: 175 passed, 1 skipped
  • end-to-end CLI coverage for duration-only and count-only warmup: 2 passed
  • uv run pre-commit run --all-files: all hooks passed

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown

Try out this PR

Quick install:

pip install --upgrade --force-reinstall git+https://github.com/ai-dynamo/aiperf.git@08ec06877e94961b54a0ca0374c168a6bb7fa1bd

Recommended with virtual environment (using uv):

uv venv --python 3.12 && source .venv/bin/activate
uv pip install --upgrade --force-reinstall git+https://github.com/ai-dynamo/aiperf.git@08ec06877e94961b54a0ca0374c168a6bb7fa1bd

Last updated for commit: 08ec068Browse code

@github-actions

github-actions Bot commented Jul 29, 2026

Copy link
Copy Markdown

Fern Docs Preview: generation failed — see the Actions log for details. This does not block merge; ask a maintainer to retry if needed.

Port the per-lane warmup quota and robust warmup-to-profiling handoff onto the AgentX v1.0 lineage.

Signed-off-by: Cam Quilici <cjquilici@gmail.com>
@cquil11
cquil11 force-pushed the cquil11/deterministic-agentic-warmup-count branch from c13b96c to 08ec068 Compare July 29, 2026 16:41
@cquil11
cquil11 changed the base branch from main to cquil11/aiperf-agentx-v1.0 July 29, 2026 16:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant