Commit af7a972
authored
Stop skipping
fix: stop tagging "test exception" testcases as synthetic skip
"test exception" is not a synthetic placeholder emitted by any test
framework — JUnit 4, JUnit Platform, Gradle's adapters, Spock and Kotest
all reserve "initializationError"/"executionError" for that purpose, not
generic English names. In dd-trace-java the entries observed in CI came
from a real Spock feature method (`def "test exception"()` in
HttpServerTest.groovy), not a framework synthetic. Tagging that name
unconditionally silently masks real pass/fail outcomes for any
Spock/JUnit 5 @DisplayName/Kotest test that happens to use it.
Drop "test exception" from JUnitReport.tagSyntheticFailures and document
the criteria for future synthetic entries (must be framework-emitted,
must link to the source pinned to a release tag). Annotate the two
remaining entries — initializationError (JUnit 4 + Gradle) and
executionError (Gradle) — with the canonical source locations.
Update JUnitReport.java
Co-authored-by: Sarah Chen <sarah.chen@datadoghq.com>
Merge branch 'master' into bdu/revert-test-exception-synthetic-skip
Co-authored-by: brice.dutheil <brice.dutheil@datadoghq.com>"test exception" test cases, they are not synthetic (#11427)1 parent 814c574 commit af7a972
1 file changed
Lines changed: 34 additions & 7 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
66 | 66 | | |
67 | 67 | | |
68 | 68 | | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
69 | 87 | | |
70 | 88 | | |
71 | 89 | | |
72 | | - | |
73 | | - | |
74 | | - | |
75 | | - | |
76 | | - | |
77 | | - | |
78 | | - | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
79 | 106 | | |
80 | 107 | | |
81 | 108 | | |
| |||
0 commit comments