Commit a8e3e62
Add support for comment /test-plan for an early on-demand test impact analysis (RedHatQE#5101)
##### What this PR does / why we need it:
The verified label is the team's signal that the PR has been
code-reviewed and tested by author. At that point the workflow fires
CodeRabbit to produce a test execution plan telling the reviewer/author
which tests to actually run to validate the change before merging.
So the sequence today is:
1. Author opens PR
2. Reviewer reviews the code
3. Author applies /verified - "code looks good and tested"
4. Workflow triggers CodeRabbit to generate the test execution plan
5. Author/reviewer runs the listed tests
6. PR merges
7. The problem identified here is step 4 comes after author does their
side of testing. The test impact analysis would be more useful during
review (between steps 2 and 3) so the reviewer can factor before signing
off. everyone knows risks involved.
That's exactly what comment /test-plan solves — anyone can apply it at
any point during review to get the plan early. This can be done by
anyone reviewing or author without marking PR verified.
##### Which issue(s) this PR fixes:
Early access to a report showing the real test impact of their PR.
##### Special notes for reviewer:
##### jira-ticket:
None
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
* **Documentation**
* Added instructions: comment "/test-plan" on a PR to request an inline
test execution plan review.
* **Chores**
* Updated CI workflow to support triggering test-plan requests from
either a PR label or an on-demand PR comment.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
Signed-off-by: Geetika Kapoor <gkapoor@redhat.com>1 parent 6d15e4e commit a8e3e62
2 files changed
Lines changed: 25 additions & 4 deletions
Lines changed: 15 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
5 | 6 | | |
6 | 7 | | |
7 | 8 | | |
| 9 | + | |
| 10 | + | |
8 | 11 | | |
9 | 12 | | |
10 | 13 | | |
| |||
13 | 16 | | |
14 | 17 | | |
15 | 18 | | |
16 | | - | |
17 | | - | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
18 | 29 | | |
19 | 30 | | |
20 | 31 | | |
| |||
23 | 34 | | |
24 | 35 | | |
25 | 36 | | |
26 | | - | |
| 37 | + | |
27 | 38 | | |
28 | 39 | | |
29 | 40 | | |
30 | 41 | | |
31 | 42 | | |
32 | 43 | | |
33 | | - | |
| 44 | + | |
34 | 45 | | |
35 | 46 | | |
36 | 47 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
112 | 112 | | |
113 | 113 | | |
114 | 114 | | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
115 | 125 | | |
116 | 126 | | |
117 | 127 | | |
| |||
0 commit comments