Skip to content

chore: repeat some benchmarks to avoid outliers#14342

Merged
Garmelon merged 7 commits into
masterfrom
joscha/outliers
Jul 9, 2026
Merged

chore: repeat some benchmarks to avoid outliers#14342
Garmelon merged 7 commits into
masterfrom
joscha/outliers

Conversation

@Garmelon

@Garmelon Garmelon commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

At this point, only the compile/incr_header_load benchmark is being repeated. As more flaky benchmarks pop up, we can repeat them as well.

The repeatedly.py script is copied and modified from mathlib's bench suite.

@github-actions github-actions Bot added toolchain-available A toolchain is available for this PR, at leanprover/lean4-pr-releases:pr-release-NNNN mathlib4-nightly-available A branch for this PR exists at leanprover-community/mathlib4-nightly-testing:lean-pr-testing-NNNN labels Jul 9, 2026
@leanprover-bot

leanprover-bot commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator

Reference manual CI status:

@leanprover-bot leanprover-bot added the builds-manual CI has verified that the Lean Language Reference builds against this PR label Jul 9, 2026
mathlib-nightly-testing Bot pushed a commit to leanprover-community/batteries that referenced this pull request Jul 9, 2026
mathlib-nightly-testing Bot pushed a commit to leanprover-community/mathlib4-nightly-testing that referenced this pull request Jul 9, 2026
leanprover-bot added a commit to leanprover/reference-manual that referenced this pull request Jul 9, 2026
mathlib-nightly-testing Bot pushed a commit to leanprover-community/batteries that referenced this pull request Jul 9, 2026
mathlib-nightly-testing Bot pushed a commit to leanprover-community/mathlib4-nightly-testing that referenced this pull request Jul 9, 2026
leanprover-bot added a commit to leanprover/reference-manual that referenced this pull request Jul 9, 2026
@mathlib-lean-pr-testing mathlib-lean-pr-testing Bot added the builds-mathlib CI has verified that Mathlib builds against this PR label Jul 9, 2026
@mathlib-lean-pr-testing

mathlib-lean-pr-testing Bot commented Jul 9, 2026

Copy link
Copy Markdown

Mathlib CI status (docs):

@Garmelon Garmelon added this pull request to the merge queue Jul 9, 2026
Merged via the queue into master with commit 69d6d52 Jul 9, 2026
25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

builds-manual CI has verified that the Lean Language Reference builds against this PR builds-mathlib CI has verified that Mathlib builds against this PR mathlib4-nightly-available A branch for this PR exists at leanprover-community/mathlib4-nightly-testing:lean-pr-testing-NNNN toolchain-available A toolchain is available for this PR, at leanprover/lean4-pr-releases:pr-release-NNNN

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants