|
1 | 1 | # Unified CI Evidence Bundle |
2 | 2 |
|
3 | | -> Generated: 2026-05-12T19:26:21Z |
4 | | -> Git ref: 80edf7ef9 |
5 | | -> CI run: local-20260512T192621Z |
6 | | -> Verdict: **COMPLETE** |
| 3 | +> Generated: 2026-06-29T12:09:11Z |
| 4 | +> Git ref: ba07485e |
| 5 | +> CI run: 28370238357 |
| 6 | +> Verdict: **INSUFFICIENT** |
7 | 7 |
|
8 | 8 | ## Summary |
9 | 9 |
|
10 | 10 | | Metric | Value | |
11 | 11 | |--------|-------| |
12 | 12 | | Total sections | 29 | |
13 | | -| Present | 29 | |
14 | | -| Missing | 0 | |
15 | | -| Invalid | 0 | |
16 | | -| Total artifacts | 2004 | |
17 | | -| Total size | 181069.7 KB | |
| 13 | +| Present | 18 | |
| 14 | +| Missing | 10 | |
| 15 | +| Invalid | 1 | |
| 16 | +| Total artifacts | 93 | |
| 17 | +| Total size | 792.5 KB | |
18 | 18 | | Required present | 12/12 | |
19 | 19 |
|
20 | 20 | ## Conformance (6) |
|
23 | 23 | |---------|--------|-------|------|------| |
24 | 24 | | Extension conformance summary | PASS | 1 | 1058 B | `tests/ext_conformance/reports/conformance_summary.json` | |
25 | 25 | | Conformance baseline | PASS | 1 | 16247 B | `tests/ext_conformance/reports/conformance_baseline.json` | |
26 | | -| Conformance event log | PASS | 1 | 223532 B | `tests/ext_conformance/reports/conformance_events.jsonl` | |
| 26 | +| Conformance event log | MISS | 0 | 0 B | `tests/ext_conformance/reports/conformance_events.jsonl` | |
27 | 27 | | Conformance report (Markdown) | PASS | 1 | 48168 B | `tests/ext_conformance/reports/CONFORMANCE_REPORT.md` | |
28 | | -| Regression gate verdict | PASS | 1 | 1658 B | `tests/ext_conformance/reports/regression_verdict.json` | |
29 | | -| Conformance trend data | PASS | 1 | 3075 B | `tests/ext_conformance/reports/conformance_trend.jsonl` | |
| 28 | +| Regression gate verdict | MISS | 0 | 0 B | `tests/ext_conformance/reports/regression_verdict.json` | |
| 29 | +| Conformance trend data | MISS | 0 | 0 B | `tests/ext_conformance/reports/conformance_trend.jsonl` | |
30 | 30 |
|
31 | 31 | ## Diagnostics (8) |
32 | 32 |
|
33 | 33 | | Section | Status | Files | Size | Path | |
34 | 34 | |---------|--------|-------|------|------| |
35 | | -| Must-pass gate verdict | PASS | 1 | 1206 B | `tests/ext_conformance/reports/gate/must_pass_gate_verdict.json` | |
36 | | -| Must-pass gate event log | PASS | 1 | 56814 B | `tests/ext_conformance/reports/gate/must_pass_events.jsonl` | |
37 | | -| Per-extension failure dossiers | PASS | 34 | 140366 B | `tests/ext_conformance/reports/dossiers` | |
38 | | -| Health & regression delta report | PASS | 3 | 88320 B | `tests/ext_conformance/reports/health_delta` | |
39 | | -| Provider compatibility matrix | PASS | 753 | 375207 B | `tests/ext_conformance/reports/provider_compat` | |
40 | | -| Sharded extension matrix reports | PASS | 12 | 280518 B | `tests/ext_conformance/reports/sharded` | |
41 | | -| Extension journey report | PASS | 1 | 14742 B | `tests/ext_conformance/reports/journeys/journey_report.json` | |
42 | | -| Auto-repair summary | PASS | 1 | 56700 B | `tests/ext_conformance/reports/auto_repair_summary.json` | |
| 35 | +| Must-pass gate verdict | PASS | 1 | 1197 B | `tests/ext_conformance/reports/gate/must_pass_gate_verdict.json` | |
| 36 | +| Must-pass gate event log | PASS | 1 | 53944 B | `tests/ext_conformance/reports/gate/must_pass_events.jsonl` | |
| 37 | +| Per-extension failure dossiers | MISS | 0 | 0 B | `tests/ext_conformance/reports/dossiers` | |
| 38 | +| Health & regression delta report | PASS | 3 | 80613 B | `tests/ext_conformance/reports/health_delta` | |
| 39 | +| Provider compatibility matrix | MISS | 0 | 0 B | `tests/ext_conformance/reports/provider_compat` | |
| 40 | +| Sharded extension matrix reports | MISS | 0 | 0 B | `tests/ext_conformance/reports/sharded` | |
| 41 | +| Extension journey report | PASS | 1 | 1185 B | `tests/ext_conformance/reports/journeys/journey_report.json` | |
| 42 | +| Auto-repair summary | MISS | 0 | 0 B | `tests/ext_conformance/reports/auto_repair_summary.json` | |
43 | 43 |
|
44 | 44 | ## E2e (1) |
45 | 45 |
|
46 | 46 | | Section | Status | Files | Size | Path | |
47 | 47 | |---------|--------|-------|------|------| |
48 | | -| E2E test results | PASS | 1176 | 183247322 B | `tests/e2e_results` | |
| 48 | +| E2E test results | PASS | 74 | 256474 B | `tests/e2e_results` | |
49 | 49 |
|
50 | 50 | ## Quarantine (2) |
51 | 51 |
|
|
61 | 61 | | Performance budget summary | PASS | 1 | 4082 B | `tests/perf/reports/budget_summary.json` | |
62 | 62 | | PERF-3X comparison report | PASS | 1 | 6350 B | `tests/perf/reports/perf_comparison.json` | |
63 | 63 | | PERF-3X parameter sweeps report | PASS | 1 | 1076 B | `tests/perf/reports/parameter_sweeps.json` | |
64 | | -| PERF-3X stress triage report | PASS | 1 | 4829 B | `tests/perf/reports/stress_triage.json` | |
65 | | -| Extension load-time benchmark | PASS | 1 | 17566 B | `tests/ext_conformance/reports/load_time_benchmark.json` | |
66 | | -| PERF-3X lineage coherence contract | PASS | 0 | 0 B | `tests/ext_conformance/reports/gate/must_pass_gate_verdict.json | tests/ext_conformance/reports/conformance_summary.json | tests/perf/reports/stress_triage.json` | |
| 64 | +| PERF-3X stress triage report | PASS | 1 | 4796 B | `tests/perf/reports/stress_triage.json` | |
| 65 | +| Extension load-time benchmark | MISS | 0 | 0 B | `tests/ext_conformance/reports/load_time_benchmark.json` | |
| 66 | +| PERF-3X lineage coherence contract | WARN | 0 | 0 B | `tests/ext_conformance/reports/gate/must_pass_gate_verdict.json | tests/ext_conformance/reports/conformance_summary.json | tests/perf/reports/stress_triage.json` | |
67 | 67 |
|
68 | 68 | ## Security (2) |
69 | 69 |
|
70 | 70 | | Section | Status | Files | Size | Path | |
71 | 71 | |---------|--------|-------|------|------| |
72 | | -| Security and licensing risk review | PASS | 1 | 86687 B | `tests/ext_conformance/artifacts/RISK_REVIEW.json` | |
| 72 | +| Security and licensing risk review | PASS | 1 | 86698 B | `tests/ext_conformance/artifacts/RISK_REVIEW.json` | |
73 | 73 | | Extension provenance verification | PASS | 1 | 143396 B | `tests/ext_conformance/artifacts/PROVENANCE_VERIFICATION.json` | |
74 | 74 |
|
75 | 75 | ## Traceability (2) |
76 | 76 |
|
77 | 77 | | Section | Status | Files | Size | Path | |
78 | 78 | |---------|--------|-------|------|------| |
79 | | -| Requirement-to-test traceability matrix | PASS | 1 | 89373 B | `docs/traceability_matrix.json` | |
| 79 | +| Requirement-to-test traceability matrix | PASS | 1 | 94477 B | `docs/traceability_matrix.json` | |
80 | 80 | | High-value suite artifact inventory | PASS | 1 | 11209 B | `docs/evidence/high-value-suite-artifact-inventory.json` | |
81 | 81 |
|
82 | 82 | ## Inventory (2) |
83 | 83 |
|
84 | 84 | | Section | Status | Files | Size | Path | |
85 | 85 | |---------|--------|-------|------|------| |
86 | | -| Extension inventory | PASS | 1 | 89349 B | `tests/ext_conformance/reports/inventory.json` | |
87 | | -| Extension inclusion manifest | PASS | 4 | 406062 B | `tests/ext_conformance/reports/inclusion_manifest` | |
| 86 | +| Extension inventory | MISS | 0 | 0 B | `tests/ext_conformance/reports/inventory.json` | |
| 87 | +| Extension inclusion manifest | MISS | 0 | 0 B | `tests/ext_conformance/reports/inclusion_manifest` | |
| 88 | + |
| 89 | +## Missing / Invalid Sections |
| 90 | + |
| 91 | +- **Conformance event log** (missing): File not found |
| 92 | + Path: `tests/ext_conformance/reports/conformance_events.jsonl` |
| 93 | +- **Regression gate verdict** (missing): File not found |
| 94 | + Path: `tests/ext_conformance/reports/regression_verdict.json` |
| 95 | +- **Conformance trend data** (missing): File not found |
| 96 | + Path: `tests/ext_conformance/reports/conformance_trend.jsonl` |
| 97 | +- **Per-extension failure dossiers** (missing): Directory not found |
| 98 | + Path: `tests/ext_conformance/reports/dossiers` |
| 99 | +- **Provider compatibility matrix** (missing): Directory not found |
| 100 | + Path: `tests/ext_conformance/reports/provider_compat` |
| 101 | +- **Sharded extension matrix reports** (missing): Directory not found |
| 102 | + Path: `tests/ext_conformance/reports/sharded` |
| 103 | +- **Auto-repair summary** (missing): File not found |
| 104 | + Path: `tests/ext_conformance/reports/auto_repair_summary.json` |
| 105 | +- **Extension load-time benchmark** (missing): File not found |
| 106 | + Path: `tests/ext_conformance/reports/load_time_benchmark.json` |
| 107 | +- **Extension inventory** (missing): File not found |
| 108 | + Path: `tests/ext_conformance/reports/inventory.json` |
| 109 | +- **Extension inclusion manifest** (missing): Directory not found |
| 110 | + Path: `tests/ext_conformance/reports/inclusion_manifest` |
| 111 | +- **PERF-3X lineage coherence contract** (invalid): PERF-3X lineage span exceeds 14 days for run_id '28370238357' (oldest=2026-05-12 19:26:24 UTC, newest=2026-06-29 12:09:10 UTC) |
| 112 | + Path: `tests/ext_conformance/reports/gate/must_pass_gate_verdict.json | tests/ext_conformance/reports/conformance_summary.json | tests/perf/reports/stress_triage.json` |
88 | 113 |
|
0 commit comments