Skip to content

Commit b23fbd2

Browse files
Merge pull request #107 from bmad-code-org/fix/nfr-planning-in-test-design
fix: neft planning in test design
2 parents 34a242c + 9d347f9 commit b23fbd2

59 files changed

Lines changed: 457 additions & 283 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

CHANGELOG.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,13 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
99

1010
### Changed
1111

12+
- NFR workflow boundary clarified: `test-design` now owns NFR planning (thresholds, planned evidence, NFR-derived risks) and `nfr-assess` is reframed as NFR Evidence Audit — evaluating implementation evidence against planned thresholds after code exists.
13+
- `nfr-assess` step-02 now checks for an existing `test-design` NFR plan first and uses it as the primary threshold source, falling back to raw documents only for missing or UNKNOWN thresholds.
14+
- TEA agent menu gains a `GATE` routing intent that guides users through the release gate sequence (optional test-review → optional nfr-assess → trace Phase 2 gate) without merging those workflows.
15+
- NFR domains in `nfr-assess` corrected from "maintainability" to "scalability" to match the four parallel subagent domains (security, performance, reliability, scalability).
16+
- TEA phase table updated: `nfr-assess` marked optional at the Release phase.
17+
- NFR planning items in `test-design` step-05 output checklist conditioned on NFR scope.
18+
- Engagement models table: TEA Solo row for NFR Evidence Audit updated from No to Optional.
1219
- GitHub Actions workflow dependencies upgraded to Node 24-compatible major versions:
1320
- `actions/checkout@v5`
1421
- `actions/setup-node@v6`

README.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
[![Python Version](https://img.shields.io/badge/python-%3E%3D3.10-blue?logo=python&logoColor=white)](https://www.python.org)
44
[![uv](https://img.shields.io/badge/uv-package%20manager-blueviolet?logo=uv)](https://docs.astral.sh/uv/)
55

6-
TEA (Test Engineering Architect) is a standalone BMAD module that delivers risk-based test strategy, test automation guidance, and release gate decisions. It provides a single expert agent (Murat, Master Test Architect and Quality Advisor) and nine workflows spanning Teach Me Testing (TEA Academy), framework setup, test design, ATDD, automation, traceability, NFR assessment, CI guidance, and test review.
6+
TEA (Test Engineering Architect) is a standalone BMAD module that delivers risk-based test strategy, test automation guidance, and release gate decisions. It provides a single expert agent (Murat, Master Test Architect and Quality Advisor) and nine workflows spanning Teach Me Testing (TEA Academy), test design, framework setup, CI guidance, ATDD, automation, test review, NFR Evidence Audit, and traceability.
77

88
Docs: <https://bmad-code-org.github.io/bmad-method-test-architecture-enterprise/>
99

@@ -123,7 +123,7 @@ npx bmad-method install
123123
1. Install TEA (above)
124124
2. Load the TEA menu with `$bmad-tea` if you want a conversational entrypoint.
125125
3. Run one of the core workflows:
126-
- `TD` / `/bmad:tea:test-design` / `$bmad-tea-testarch-test-design` — test design and risk assessment
126+
- `TD` / `/bmad:tea:test-design` / `$bmad-tea-testarch-test-design` — test design, risk assessment, and NFR planning
127127
- `AT` / `/bmad:tea:atdd` / `$bmad-tea-testarch-atdd` — failing acceptance tests first (TDD red phase)
128128
- `TA` / `/bmad:tea:automate` / `$bmad-tea-testarch-automate` — expand automation coverage
129129
4. Or use in party mode: `/party` to include TEA with other agents
@@ -140,14 +140,14 @@ npx bmad-method install
140140
| Trigger | Slash Command | Codex Skill | Purpose |
141141
| ------- | ---------------------------- | -------------------------------- | --------------------------------------------------------- |
142142
| TMT | `/bmad:tea:teach-me-testing` | `$bmad-tea-teach-me-testing` | Teach Me Testing (TEA Academy) |
143+
| TD | `/bmad:tea:test-design` | `$bmad-tea-testarch-test-design` | System-level or epic-level test design and NFR planning |
143144
| TF | `/bmad:tea:framework` | `$bmad-tea-testarch-framework` | Scaffold test framework (frontend, backend, or fullstack) |
144145
| CI | `/bmad:tea:ci` | `$bmad-tea-testarch-ci` | Set up CI/CD quality pipeline (multi-platform) |
145-
| TD | `/bmad:tea:test-design` | `$bmad-tea-testarch-test-design` | System-level or epic-level test design |
146146
| AT | `/bmad:tea:atdd` | `$bmad-tea-testarch-atdd` | Generate failing acceptance tests + checklist |
147147
| TA | `/bmad:tea:automate` | `$bmad-tea-testarch-automate` | Expand test automation coverage |
148148
| RV | `/bmad:tea:test-review` | `$bmad-tea-testarch-test-review` | Review test quality and score |
149+
| NR | `/bmad:tea:nfr-assess` | `$bmad-tea-testarch-nfr` | Audit implemented NFR evidence |
149150
| TR | `/bmad:tea:trace` | `$bmad-tea-testarch-trace` | Trace requirements to tests + gate decision |
150-
| NR | `/bmad:tea:nfr-assess` | `$bmad-tea-testarch-nfr` | Assess non-functional requirements |
151151

152152
## Configuration
153153

docs/explanation/engagement-models.md

Lines changed: 15 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -205,12 +205,11 @@ Steps:
205205
**Phase 2: Planning**
206206

207207
- PM creates PRD with NFRs
208-
- (Optional) TEA runs `nfr-assess` (Enterprise only)
209208

210209
**Phase 3: Solutioning**
211210

212211
- Architect creates architecture
213-
- TEA runs `test-design` (system-level) → testability review
212+
- TEA runs `test-design` (system-level) → testability review and NFR evidence plan
214213
- TEA runs `framework` → test infrastructure
215214
- TEA runs `ci` → CI/CD pipeline
216215
- Architect runs `implementation-readiness` (fed by test design)
@@ -229,7 +228,7 @@ Steps:
229228
**Release Gate:**
230229

231230
- (Optional) TEA runs `test-review` → final audit
232-
- (Optional) TEA runs `nfr-assess`validate NFRs
231+
- (Optional) TEA runs `nfr-assess`audit NFR evidence
233232
- TEA runs `trace` Phase 2 → gate decision (PASS/CONCERNS/FAIL/WAIVED)
234233

235234
**What You Get:**
@@ -396,7 +395,7 @@ flowchart TD
396395
| -------------------------- | --------------------------- | ----------------------------- |
397396
| **None** | Any model | Choose based on project needs |
398397
| **Light** (internal audit) | TEA Solo or Integrated | Gate decisions helpful |
399-
| **Heavy** (SOC 2, HIPAA) | TEA Integrated (Enterprise) | NFR assessment mandatory |
398+
| **Heavy** (SOC 2, HIPAA) | TEA Integrated (Enterprise) | NFR evidence audit mandatory |
400399

401400
## Switching Between Models
402401

@@ -444,17 +443,17 @@ Result: TEA where it adds value, skip where it doesn't
444443

445444
## Comparison Table
446445

447-
| Aspect | No TEA | TEA Lite | TEA Solo | Integrated (Green) | Integrated (Brown) |
448-
| --------------------- | ------- | --------- | ---------- | ------------------ | ------------------ |
449-
| **BMad Required** | No | No | No | Yes | Yes |
450-
| **Learning Curve** | None | Low | Medium | High | High |
451-
| **Setup Time** | 0 | 30 min | 2 hours | 1 day | 2 days |
452-
| **Workflows Used** | 0 | 2-3 | 4-6 | 8 | 8 |
453-
| **Test Planning** | Manual | Optional | Yes | Systematic | + Regression focus |
454-
| **Quality Gates** | No | No | Optional | Yes | Yes + baseline |
455-
| **NFR Assessment** | No | No | No | Optional | Recommended |
456-
| **Coverage Tracking** | Manual | No | Optional | Yes | Yes + trending |
457-
| **Best For** | Experts | Beginners | Standalone | New projects | Legacy code |
446+
| Aspect | No TEA | TEA Lite | TEA Solo | Integrated (Green) | Integrated (Brown) |
447+
| ---------------------- | ------- | --------- | ---------- | ------------------ | ------------------ |
448+
| **BMad Required** | No | No | No | Yes | Yes |
449+
| **Learning Curve** | None | Low | Medium | High | High |
450+
| **Setup Time** | 0 | 30 min | 2 hours | 1 day | 2 days |
451+
| **Workflows Used** | 0 | 2-3 | 4-6 | 8 | 8 |
452+
| **Test Planning** | Manual | Optional | Yes | Systematic | + Regression focus |
453+
| **Quality Gates** | No | No | Optional | Yes | Yes + baseline |
454+
| **NFR Evidence Audit** | No | No | Optional | Optional | Recommended |
455+
| **Coverage Tracking** | Manual | No | Optional | Yes | Yes + trending |
456+
| **Best For** | Experts | Beginners | Standalone | New projects | Legacy code |
458457

459458
## Real-World Examples
460459

@@ -496,7 +495,7 @@ Decision: Full BMad Method + TEA Integrated
496495
Result:
497496
- Full lifecycle integration
498497
- Quality gates before releases
499-
- NFR assessment for enterprise customers
498+
- NFR evidence audit for enterprise customers
500499
```
501500

502501
### Example 2: Enterprise (TEA Integrated - Brownfield)

docs/explanation/risk-based-testing.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -611,7 +611,7 @@ flowchart TD
611611

612612
- [How to Run Test Design](/docs/how-to/workflows/run-test-design.md) - Apply risk scoring
613613
- [How to Run Trace](/docs/how-to/workflows/run-trace.md) - Gate decisions based on risk
614-
- [How to Run NFR Assessment](/docs/how-to/workflows/run-nfr-assess.md) - NFR risk assessment
614+
- [How to Run NFR Evidence Audit](/docs/how-to/workflows/run-nfr-assess.md) - NFR evidence status for gate decisions
615615

616616
**Use-Case Guides:**
617617

0 commit comments

Comments
 (0)