Skip to content

Commit cc9fbc3

Browse files
authored
[SDCT-733] Document broken flaky test handling (#38385)
* Document broken flaky test handling * Apply suggestion from @TovRudyy * SDCT-733 Move broken test note into fixed policy row
1 parent 3959091 commit cc9fbc3

1 file changed

Lines changed: 5 additions & 1 deletion

File tree

content/en/tests/flaky_management/_index.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -86,7 +86,11 @@ Configure automated Flaky Test Policies to govern how flaky tests are handled in
8686
</tr>
8787
<tr>
8888
<td>{{< ui >}}Fixed{{< /ui >}}</td>
89-
<td>If a flaky test no longer flakes for 30 days, it is automatically moved to the Fixed state. This automation is default behavior and can't be customized.</td>
89+
<td>
90+
<p>If a flaky test no longer flakes for 30 days, it is automatically moved to the Fixed state. This automation is default behavior and can't be customized.</p>
91+
<p>Before Datadog automatically moves a flaky test to {{< ui >}}Fixed{{< /ui >}}, it checks whether the test may be broken rather than fixed. A broken test is a flaky test whose recent executions all failed, resulting in a 100% failure rate over the last 7 days. Datadog does not automatically mark these tests as fixed, which helps prevent quarantined tests that still fail from breaking CI again.</p>
92+
<p>Use the {{< ui >}}Broken test{{< /ui >}} facet in the Flaky Tests Management explorer to identify these tests. Filter on <code>broken_test:true</code> to show tests with a 100% failure rate over the last 7 days.</p>
93+
</td>
9094
</tr>
9195
</tbody>
9296
</table>

0 commit comments

Comments
 (0)