|
1 | 1 | # CRG Grade C Test Coverage |
2 | 2 |
|
| 3 | +## CRG Grade: B — ACHIEVED 2026-04-04 |
| 4 | + |
| 5 | +> CRG B achieved 2026-04-04: Validated A2ML manifests from 6 diverse external repos + ran 18 internal tests. |
| 6 | +
|
| 7 | +## CRG B Evidence — External Targets |
| 8 | + |
| 9 | +| Target Repo | A2ML File | What Was Tested | Result | |
| 10 | +|-------------|-----------|-----------------|--------| |
| 11 | +| gossamer | 0-AI-MANIFEST.a2ml | Structural compliance (8 required fields) | SCORE 8/8 (106 lines, 4851B) | |
| 12 | +| boj-server | 0-AI-MANIFEST.a2ml | Structural compliance (8 required fields) | SCORE 8/8 (110 lines, 5036B) | |
| 13 | +| echidna | 0-AI-MANIFEST.a2ml | Structural compliance (8 required fields) | SCORE 3/8 (103 lines, 4507B) | |
| 14 | +| panic-attacker | 0-AI-MANIFEST.a2ml | Structural compliance (8 required fields) | SCORE 4/8 (119 lines, 4007B) | |
| 15 | +| hypatia | 0-AI-MANIFEST.a2ml | Structural compliance (8 required fields) | SCORE 8/8 (117 lines, 5295B) | |
| 16 | +| standards | 0-AI-MANIFEST.a2ml | Structural compliance (8 required fields) | SCORE 1/8 (128 lines, 4383B) | |
| 17 | + |
| 18 | +### Compliance fields checked |
| 19 | + |
| 20 | +1. `SPDX-License-Identifier` header |
| 21 | +2. `(manifest ...)` wrapper |
| 22 | +3. `(identity ...)` section |
| 23 | +4. `(purpose ...)` section |
| 24 | +5. `(name ...)` field |
| 25 | +6. `(version ...)` field |
| 26 | +7. `(context ...)` tiers |
| 27 | +8. `(canonical ...)` locations |
| 28 | + |
| 29 | +### Target Details |
| 30 | + |
| 31 | +**1. gossamer (Gleam/Rust — window manager)** |
| 32 | +- File: `/var/mnt/eclipse/repos/gossamer/0-AI-MANIFEST.a2ml` |
| 33 | +- Result: FULL COMPLIANCE. All 8 structural fields present. Proper S-expression format with identity, purpose, context-tiers, canonical-locations, and invariants. |
| 34 | + |
| 35 | +**2. boj-server (ReScript/Deno — MCP server)** |
| 36 | +- File: `/var/mnt/eclipse/repos/boj-server/0-AI-MANIFEST.a2ml` |
| 37 | +- Result: FULL COMPLIANCE. All 8 structural fields present. Well-structured manifest with 110 lines. |
| 38 | + |
| 39 | +**3. echidna (Rust — theorem prover)** |
| 40 | +- File: `/var/mnt/eclipse/repos/echidna/0-AI-MANIFEST.a2ml` |
| 41 | +- Result: INCOMPLETE (3/8). Has SPDX and context/canonical but uses non-standard structure missing (manifest), (identity), (purpose), (name), (version) wrappers. Needs migration to standard A2ML format. |
| 42 | + |
| 43 | +**4. panic-attacker (Rust — security scanner)** |
| 44 | +- File: `/var/mnt/eclipse/repos/panic-attacker/0-AI-MANIFEST.a2ml` |
| 45 | +- Result: INCOMPLETE (4/8). Has SPDX, (manifest), version, canonical but missing (identity), (purpose), (name) sections. Partially migrated format. |
| 46 | + |
| 47 | +**5. hypatia (Elixir/Rust — CI/CD scanner)** |
| 48 | +- File: `/var/mnt/eclipse/repos/hypatia/0-AI-MANIFEST.a2ml` |
| 49 | +- Result: FULL COMPLIANCE. All 8 structural fields present. 117 lines with comprehensive context tiers. |
| 50 | + |
| 51 | +**6. standards (Mixed — multi-standard monorepo)** |
| 52 | +- File: `/var/mnt/eclipse/repos/standards/0-AI-MANIFEST.a2ml` |
| 53 | +- Result: MINIMAL (1/8). Large file (128 lines, 4383B) but uses legacy format without standard S-expression structure. Only canonical locations present. Needs full rewrite. |
| 54 | + |
| 55 | +### Internal test suite also passing |
| 56 | + |
| 57 | +All 18 internal tests pass (Unit: 4, Smoke: 3, Contract: 2, Aspect: 3, Property: 2, E2E: 2, Benchmark: 2). |
| 58 | + |
3 | 59 | **Repository:** a2ml-showcase |
4 | 60 | **Grade:** C |
5 | 61 | **Last Updated:** 2026-04-04 |
|
0 commit comments