Skip to content

Implementation Plan: T5-P1-A7-WP2 Disposition Table — Conformance Evidence Gap Fix #4135

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Trecek merged 1 commit into from
Jun 28, 2026
Merged

Implementation Plan: T5-P1-A7-WP2 Disposition Table — Conformance Evidence Gap Fix #4135

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 4 additions & 3 deletions .autoskillit/temp/p1_a7_wp2_disposition_table.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -55,9 +55,9 @@ Columns: `issue_number | title_short | disposition | evidence | generator | note
| Issue | Title Short | Disposition | Evidence | Generator | Notes |
|-------|-------------|-------------|----------|-----------|-------|
| #3124 | test_backend_compliance.py | SUPERSEDED | `95b745031` (PR #3594); superseded by `4cadec7f8` (PR #3991) which delivered the full conformance class | R-G/P5 | Original compliance file evolved into `TestCodingAgentBackendConformance` with 31 methods (extended by PR #4081). **Counted once in §2 above.** |
| #3273 | Backend-parametrized CLI tests | SUPERSEDED | `4537136a8` (PR #3299); conformance class parametrized over `BACKEND_REGISTRY` covers both backends | R-G | Cross-validation contract coverage delivered by parametrized conformance tests |
| #3385 | Codex Backend Architectural Immunity | ABSORBED | WP1 mapped to R-A/A1, R-A/A3; 8 forward-declared capability fields remain without production consumers; `CodexBackend.build_inspector_cmd()` at `codex.py:1117-1119` raises `AssertionError("inspector_capable is True but build_inspector_cmd has no implementation")` | R-G | Partially delivered: capability consumption arch test exists (`test_capability_consumption.py`) but enforcement completeness gaps remain |
| #2841 | Ticket Grouper effort-based splitting | INDEPENDENT | N/A | R-G/PY8 | **Discrepancy:** PY8 referenced this as "Conformance test class parametrized over both backends" but current issue content is about audit skill's ticket grouper (effort-based splitting for multi-file findings). Current title/content is INDEPENDENT — no program WP covers ticket grouper improvements. If intended as conformance: SUPERSEDED by `4cadec7f8` |
| #3273 | Backend-parametrized CLI tests | SUPERSEDED | `4537136a8` (PR #3299); `4cadec7f8` (PR #3991) delivered full `TestCodingAgentBackendConformance` with 33 methods parametrized over `BACKEND_REGISTRY`; extended by PR #4081 (B2 behavioral conformance suite) | R-G | Cross-validation contract coverage delivered by parametrized conformance tests. B2 remaining gap: env injection presence, resume-id inclusion, and flag semantics behavioral tests not yet exhaustive per R-B/B2 spec |
| #3385 | Codex Backend Architectural Immunity | ABSORBED | WP1 mapped to R-A/A1, R-A/A3; `4cadec7f8` (PR #3991) delivered `TestCodingAgentBackendConformance` with structural conformance coverage; 8 forward-declared capability fields remain without production consumers; `CodexBackend.build_inspector_cmd()` at `codex.py:1117-1119` raises `AssertionError` | R-G | Partially delivered: conformance class (`4cadec7f8`) covers type-level contracts. B2 remaining gap: behavioral conformance (env injection presence, symmetric env forwarding, NotImplementedError arch tests for capability-gated methods) not yet covered per R-B/B2 spec. Enforcement completeness gaps remain under R-A/A1 and R-A/A3 |
| #2841 | Ticket Grouper effort-based splitting | INDEPENDENT | N/A | R-G/PY8 | **Discrepancy:** PY8 referenced this as "Conformance test class parametrized over both backends" but current issue content is about audit skill's ticket grouper (effort-based splitting for multi-file findings). Current title/content is INDEPENDENT — no program WP covers ticket grouper improvements. If intended as conformance: SUPERSEDED by `4cadec7f8` (PR #3991, `TestCodingAgentBackendConformance` with 33 methods). B2 note: conformance behavioral gaps (R-B/B2) are tracked separately and do not affect this issue's INDEPENDENT classification |

### §4 — Builder-Divergence (#3699)

Expand Down Expand Up @@ -132,6 +132,7 @@ To identify post-kickoff issues in scope clusters, run:
3. **#2841 issue check:** Current title is "Ticket Grouper needs effort-based splitting for multi-file findings". Body describes audit skill Ticket Grouper improvements, not conformance tests. Classified INDEPENDENT per current content.
4. **#3699 codebase check:** `BackendCmdBuilderBase` ABC confirmed at `src/autoskillit/execution/backends/_backend_cmd_builder_base.py:64`. `CodexBackend` and `ClaudeCodeBackend` both inherit from it. Notes updated to reflect further consolidation progress.
5. **#3124 double-listing:** Appears in both §2 (string-to-capability) and §3 (conformance) but counted once in summary statistics.
6. **Criterion 2 conformance cross-references (added 2026-06-28):** All four conformance-test issues (#3124, #3273, #3385, #2841) now carry explicit references to commit `4cadec7f8` (PR #3991, `TestCodingAgentBackendConformance`). B2 behavioral conformance gaps (R-B/B2: env injection presence, resume-id inclusion, flag semantics) are noted where applicable. #3273 and #3385 identify specific B2 gaps; #2841's INDEPENDENT classification is unaffected by B2 tracking.

## Summary Statistics

Expand Down
Loading