Commit 0f76352
committed
perf(ab_test): ignore noisy network and MMDS metrics on flaky instances
Add m5n.metal (al2 host), m8g.metal-{24,48}xl, and m8i.metal-{48,96}xl
to the IGNORED list for network latency and MMDS A/B tests respectively.
These instance/metric combinations exhibit high variance (up to 67%
swings in both directions) on unrelated commits, causing persistent
false-positive pipeline failures. The noise on m8g correlates with the
May 2 AL2023 rootfs update and affects only guest kernel linux-6.1
dimensions. MMDS noise on m8i is bidirectional within the same build.
The tests still run and collect data on these instances; they just no
longer block the pipeline.
Signed-off-by: Riccardo Mancini <mancio@amazon.com>1 parent 7df7152 commit 0f76352
1 file changed
Lines changed: 16 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
140 | 140 | | |
141 | 141 | | |
142 | 142 | | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
| 154 | + | |
| 155 | + | |
| 156 | + | |
| 157 | + | |
| 158 | + | |
143 | 159 | | |
144 | 160 | | |
145 | 161 | | |
| |||
0 commit comments