You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add no-code Test Plan and Workflow Design modes to reflective-spec-plan
Implement the bounded, in-place repair licensed by the corrected
evidence/promotion gate (cbb0b6c): operationalize test design and
workflow design as modes *inside* reflective-spec-plan, not as a new
skill and not as Prompt Sources pointers (install copies only SKILL.md,
so a pointer would not reach installed users).
- reflective-spec-plan: Test Plan Mode (requirement-to-test matrix,
negative/edge/regression/adversarial, false-positive guards) and
Workflow Design Mode (formalization ladder, control model, state/
artifacts, transition ownership, recovery, verification) + an
Implementation Decision Gate (Claim/Evidence/Unknowns/Counterargument/
Decision/Falsifier). Description and body now match.
- reflective-dispatch: route table + explicit test-design and
workflow-design boundaries (executable work routes to
reflective-implement; comparison to research; review to review).
- README, skill-map, trigger cheatsheets: reflect the two new modes.
- benchmark + route eval (route-001/002) updated for the new routing.
- Regenerated stale index.json.
Guardrails preserve the runtime non-goal: a workflow spec is not proof
of persistence, replay, recovery, cancellation, or idempotency.
Verified: project-knowledge, governance, links, lint, 52 tests, and the
routing paraphrase eval (100% consistency) all pass.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
"description": "Use this to turn a requirement into a practical spec, usage-first design, and small reviewable task plan. Trigger when the user asks for a spec, PRD, tickets, implementation plan, workflow plan, or wants to avoid building the wrong thing.",
4299
+
"description": "Use this to turn a requirement into a practical spec, usage-first design, reviewable task plan, no-code Test Plan, or agent workflow design. Trigger when the user asks for a spec, PRD, tickets, implementation plan, workflow plan, stateful or resumable workflow specification, rigorous test design before implementation, or wants to avoid building the wrong thing.",
4293
4300
"license": "MIT",
4294
4301
"frontmatter": {
4295
4302
"name": "reflective-spec-plan",
4296
-
"description": "Use this to turn a requirement into a practical spec, usage-first design, and small reviewable task plan. Trigger when the user asks for a spec, PRD, tickets, implementation plan, workflow plan, or wants to avoid building the wrong thing.",
4303
+
"description": "Use this to turn a requirement into a practical spec, usage-first design, reviewable task plan, no-code Test Plan, or agent workflow design. Trigger when the user asks for a spec, PRD, tickets, implementation plan, workflow plan, stateful or resumable workflow specification, rigorous test design before implementation, or wants to avoid building the wrong thing.",
- Tested 15 groups with 113 paraphrases, including 4 adversarial boundary groups, the minimality gate, and both sides of the Test Plan / executable-test boundary
90
+
- Tested 16 groups with 128 paraphrases, including 4 adversarial boundary groups, the minimality gate, and the Test Plan, executable-test, and workflow-design boundaries
The current routing consistency measurement is 100.0% on ROUTE-001 across 15 groups and 113 paraphrases. The eval fixture is now the single source of truth for thresholds, expected workflows, trace fields, and adversarial sets, while `route_paraphrase_eval.py` is responsible for loading the fixture and measuring the current router. This passes the Phase-1 threshold (>=70%) and aspirational target (>=95%) for the expanded seeded boundary set, including the minimality gate and the Test Plan / executable-test boundary. The ROUTING_CONTRACT.md keeps both bars explicit so future evals can distinguish minimum acceptance from aspirational quality.
220
+
The current routing consistency measurement is 100.0% on ROUTE-001 across 16 groups and 128 paraphrases. The eval fixture is now the single source of truth for thresholds, expected workflows, trace fields, and adversarial sets, while `route_paraphrase_eval.py` is responsible for loading the fixture and measuring the current router. This passes the Phase-1 threshold (>=70%) and aspirational target (>=95%) for the expanded seeded boundary set, including the minimality gate and the Test Plan, executable-test, and workflow-design boundaries. The ROUTING_CONTRACT.md keeps both bars explicit so future evals can distinguish minimum acceptance from aspirational quality.
221
221
222
222
### Critical Reflection
223
223
@@ -227,19 +227,22 @@ ROUTE-001 should not be interpreted as proof that routing is solved. The useful
227
227
- research vs local review
228
228
- clarification vs planning
229
229
- handoff vs dispatch
230
+
- workflow design vs executable orchestration
231
+
- workflow research or review vs first-draft design
232
+
- workflow formalization selection vs committing to a workflow
230
233
231
234
The latest router improvement uses concept-level boundary rules for these cases instead of raw synonym accumulation. Future improvements should add unseen holdout cases or baseline-vs-skill evaluation before claiming general routing quality.
232
235
233
236
### Holdout Tracking
234
237
235
-
ROUTE-002 currently measures unseen phrasing separately from ROUTE-001. It passes the holdout aspirational target with 100.0% consistency after adding concept-level reviewand clarification boundaries. This should still be treated as a seeded holdout, not proof of broad semantic routing; the next useful step is adding fresh holdout cases before further router tuning.
238
+
ROUTE-002 currently measures unseen phrasing separately from ROUTE-001. It passes the holdout aspirational target with 100.0% consistency after adding concept-level review, clarification, workflow-design, and orchestration-selection boundaries. This should still be treated as a seeded holdout, not proof of broad semantic routing; the next useful step is adding fresh holdout cases before further router tuning.
236
239
237
240
## Next Steps (Phase 2)
238
241
239
242
Based on the research and current implementation, suggested next steps:
240
243
241
244
1.**Expand ROUTE-002 with fresh holdout cases** - Add unseen cases before further router tuning
242
-
2.**Run benchmark tests** - Execute the 20 tasks with/without skills to measure effectiveness
245
+
2.**Run benchmark tests** - Execute the 23 tasks with/without skills to measure effectiveness
243
246
3.**Add CI/CD** - Integrate validation scripts into automated pipeline
244
247
4.**Collect feedback** - Use CONTRIBUTING.md process to gather community input
245
248
5.**Iterate on routing** - Use paraphrase eval results to improve keyword matching
0 commit comments