You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: .github/instructions/ado-workflow.instructions.md
+57-2Lines changed: 57 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,5 @@
1
1
---
2
-
description: "Required workflow for Azure DevOps work item tracking, Git branching, pull requests, and branch cleanupin the Playwright project."
2
+
description: "Required workflow for Azure DevOps work item tracking, Git branching, pull requests, branch cleanup, and QA test coverage in the Playwright101 project."
3
3
applyTo: "**"
4
4
maturity: stable
5
5
---
@@ -9,7 +9,7 @@ maturity: stable
9
9
## ADO Organization and Project
10
10
11
11
* Organization: `MngEnvMCAP675646`
12
-
* Project: `Playwright`
12
+
* Project: `Playwright101`
13
13
14
14
All work items, boards, and test plans live in this project.
15
15
@@ -107,6 +107,57 @@ After the pull request is merged and closed in GitHub:
107
107
108
108
Always delete both the remote and local feature branch after a successful merge. Do not keep stale branches.
109
109
110
+
## QA and Test Coverage
111
+
112
+
QA artifacts in Azure DevOps follow a strict hierarchy and traceability model. Every User Story must be verified by Test Cases that are organized into Test Suites within a Test Plan.
113
+
114
+
### Test Artifact Hierarchy
115
+
116
+
Follow this strict hierarchy for every QA artifact:
117
+
118
+
```text
119
+
Test Plan
120
+
└── Test Suite (static)
121
+
└── Test Case
122
+
└── Tests (link) ──> User Story
123
+
```
124
+
125
+
Rules:
126
+
127
+
* Every Test Case must belong to a Test Suite.
128
+
* Every Test Suite must belong to a Test Plan.
129
+
* Prefer **static** test suites over query-based or requirement-based suites for now.
130
+
* Create the parent Test Plan and Test Suite first if they do not exist before creating Test Cases.
131
+
* Test Plans, Test Suites, and Test Cases must include the tag `Agentic AI` (consistent with other work items).
132
+
133
+
### Test Coverage Requirements
134
+
135
+
Every User Story must be covered by Test Cases that exercise its acceptance criteria:
136
+
137
+
* A User Story must be covered by **at least as many Test Cases as it has acceptance criteria** (one Test Case per AC at minimum).
138
+
* Each Test Case should map clearly to one acceptance criterion. Reference the AC identifier (for example, `AC-1`) in the Test Case title or steps so traceability is obvious.
139
+
* Additional Test Cases beyond the AC count are allowed and encouraged for edge cases, negative paths, and regression coverage.
140
+
* A User Story is **not considered ready for closure** until its Test Cases exist, are linked, and are part of the active Test Plan.
141
+
142
+
### Tests Link Requirement
143
+
144
+
Every Test Case that verifies a User Story must use the Azure DevOps **`Tests`** link type to establish traceability:
145
+
146
+
* Link direction: Test Case → `Tests` → User Story.
147
+
* The reverse link (`Tested By`) is created automatically on the User Story.
148
+
* Do **not** use generic `Related` links in place of the `Tests` link; the `Tests` relationship is what enables ADO test coverage reports and traceability matrices.
149
+
* Verify the link appears under the User Story's **Related Work** section as `Tested By` before considering the Test Case complete.
150
+
151
+
### QA Workflow Summary
152
+
153
+
1. Identify the User Story and count its acceptance criteria.
154
+
2. Ensure (or create) a Test Plan for the parent Feature or release.
155
+
3. Ensure (or create) a static Test Suite under that Test Plan for the User Story or Feature scope.
156
+
4. Create one Test Case per acceptance criterion (minimum), referencing the AC identifier in the title.
157
+
5. Add each Test Case to the static Test Suite.
158
+
6. Link each Test Case to the User Story using the `Tests` link type.
159
+
7. Tag every Test Plan, Test Suite, and Test Case with `Agentic AI`.
160
+
110
161
## Quick Reference
111
162
112
163
| Step | Command or Action |
@@ -118,3 +169,7 @@ Always delete both the remote and local feature branch after a successful merge.
118
169
| After merge: sync |`git checkout main && git pull origin main`|
119
170
| After merge: delete remote |`git push origin --delete feature/{id}-description`|
120
171
| After merge: delete local |`git branch -d feature/{id}-description`|
172
+
| Test coverage minimum | One Test Case per acceptance criterion on the User Story |
173
+
| Test artifact hierarchy | Test Plan -> Test Suite (static) -> Test Case |
174
+
| Test Case to User Story link | Use the `Tests` link type (creates `Tested By` on the User Story) |
175
+
| Test artifact tag | Apply `Agentic AI` to every Test Plan, Test Suite, and Test Case |
0 commit comments