Skip to content

Trim sweep-enabled concurrency to min instead of max#1576

Merged
Oseltamivir merged 1 commit into
mainfrom
sweep-enabled-trim-min
May 27, 2026
Merged

Trim sweep-enabled concurrency to min instead of max#1576
Oseltamivir merged 1 commit into
mainfrom
sweep-enabled-trim-min

Conversation

@Oseltamivir
Copy link
Copy Markdown
Collaborator

@Oseltamivir Oseltamivir commented May 27, 2026

Summary

  • trim_conc() in utils/process_changelog.py now keeps the lowest concurrency point per parallelism config (was: highest). Single-node entries collapse to the min-conc entry per group; multi-node conc-lists collapse to [min(conc)].
  • Updated the conflicting-labels error in .github/workflows/run-sweep.yml and the trim-behavior paragraphs in AGENTS.md to match.

Behavior only changes for PRs with the sweep-enabled label (the --trim-conc path). full-sweep-enabled and push-to-main runs are unaffected — they continue to run the full untrimmed sweep.

Test plan

  • Dispatch e2e-tests against this branch with a H100 gptoss config to confirm the matrix/benchmark pipeline still runs end-to-end.
  • Optionally label this PR sweep-enabled to confirm the trimmed configs land on min(conc) per parallelism row.

Note

Medium Risk
Changes which benchmark points run on labeled PR sweeps (lower load, different latency/throughput signal); full sweeps and main pushes are unaffected.

Overview
For PRs labeled sweep-enabled, the --trim-conc path now keeps the lowest concurrency per parallelism config instead of the highest.

trim_conc() in utils/process_changelog.py uses min for single-node grouping and collapses multi-node conc lists to [min(conc)]. Docs in AGENTS.md and the conflicting-labels message in run-sweep.yml were updated to match. full-sweep-enabled and push-to-main sweeps are unchanged.

Reviewed by Cursor Bugbot for commit 6342f9e. Bugbot is set up for automated code reviews on this repo. Configure here.

For PRs labeled `sweep-enabled`, `--trim-conc` now collapses each
parallelism config to its lowest concurrency point instead of its
highest. Validation runs that only need a smoke point are cheaper at
the bottom of the curve and free up shared-cluster time for full-sweep
work elsewhere.

Updated the conflicting-labels error in `run-sweep.yml` and the
matching paragraphs in `AGENTS.md` so the operator-facing wording
matches the new behavior.
@Oseltamivir Oseltamivir requested a review from a team May 27, 2026 22:32
@Oseltamivir Oseltamivir merged commit 99acc90 into main May 27, 2026
16 of 17 checks passed
@Oseltamivir Oseltamivir deleted the sweep-enabled-trim-min branch May 27, 2026 22:35
Copy link
Copy Markdown
Contributor

@claude claude Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM — mechanical max→min flip in trim_conc() with matching doc/error-message updates.

Extended reasoning...

Overview

This PR flips the trim_conc() behavior in utils/process_changelog.py from keeping the highest concurrency point per parallelism config to keeping the lowest. The change is three lines of code (maxmin in two places, max(conc)min(conc) in the multi-node branch) plus corresponding documentation updates in AGENTS.md and the conflicting-labels error message in .github/workflows/run-sweep.yml.

Security risks

None. This is benchmark sweep configuration logic — no auth, crypto, user input, or external surface area. Worst case impact is selecting different concurrency points for labeled PR benchmark runs.

Level of scrutiny

Low. Behavior only changes on the sweep-enabled PR label path (--trim-conc); full-sweep-enabled and push-to-main paths are untouched, so main-branch performance tracking is unaffected. The change is mechanical and the three files are kept consistent (code, docs, error message all reference 'min' / 'lowest' now).

Other factors

The bug hunting system found no issues. The diff is small (~10 lines effective change) and self-contained. No tests were updated, but the existing function is straightforward and the inversion is symmetric (min and max behave identically structurally over a non-empty iterable of comparable ints).

Oseltamivir added a commit that referenced this pull request May 27, 2026
Resolves conflicts with PR #1576 (trim-to-min). For the
multi-conflicting-labels guardrail in run-sweep.yml and the matching
prose in AGENTS.md, keep this branch's three-label structure
(sweep-enabled / full-sweep-enabled / non-canary-full-sweep-enabled)
and the canary-gate description for full-sweep-enabled, and update the
sweep-enabled wording from "max(conc)" → "min(conc)" to match the
new trim_conc behavior on main. utils/process_changelog.py auto-merged
cleanly to the new lowest-`conc` implementation.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Development

Successfully merging this pull request may close these issues.

1 participant