Skip to content

Commit 4413a7a

Browse files
committed
Raise Reassure stability check thresholds to reduce CI flakiness
The stability check compares the same code against itself, so any deviation is purely CI runner noise. The current 10ms/20% thresholds are too tight for shared CI runners, causing ~37% false positive failure rate. Raising to 20ms/40% for the stability check while keeping 10ms/20% for the actual delta regression check.
1 parent 2c4f1bd commit 4413a7a

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

.github/workflows/reassurePerfTests.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@ jobs:
3535
retry_on: error
3636
command: node .github/actions/javascript/reassureStabilityCheck
3737
env:
38-
ALLOWED_DURATION_DEVIATION: 10
39-
ALLOWED_RELATIVE_DURATION_DEVIATION: 20
38+
ALLOWED_DURATION_DEVIATION: 20
39+
ALLOWED_RELATIVE_DURATION_DEVIATION: 40
4040
IS_VALIDATING_STABILITY: true
4141

4242
- name: Checkout PR head SHA

0 commit comments

Comments
 (0)