Skip to content

Commit 3c1744f

Browse files
hyperpolymathclaude
andcommitted
Remove template-only ABI files that falsely implied formal verification
Template Idris2 ABI files (Types.idr, Layout.idr, Foreign.idr) contained only RSR template scaffolding with unresolved placeholders and no domain-specific proofs. Removed to prevent false impression of formal verification coverage. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent abc3938 commit 3c1744f

6 files changed

Lines changed: 92 additions & 751 deletions

File tree

PROOF-NEEDS.md

Lines changed: 33 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,33 @@
1+
# PROOF-NEEDS.md — maa-framework
2+
3+
## Current State
4+
5+
- **src/abi/*.idr**: NO
6+
- **Dangerous patterns**: 1 `Admitted` in `proofs/coq/lambda/LambdaCNO.v` (y_not_cno theorem)
7+
- **LOC**: ~22,700 (Rust + Coq)
8+
- **ABI layer**: Missing
9+
- **Existing proofs**: Coq proofs for lambda CNO (3/4 proven), quantum mechanics exactness
10+
11+
## What Needs Proving
12+
13+
| Component | What | Why |
14+
|-----------|------|-----|
15+
| Y combinator non-CNO (y_not_cno) | Close the remaining Admitted proof | 1 of 4 lambda CNO theorems is incomplete |
16+
| Absolute-zero brainfuck interpreter | Interpreter preserves CNO properties | Claims of computational zero need formal backing |
17+
| Absolute-zero whitespace interpreter | Same as brainfuck — CNO preservation | Both esoteric interpreters need same guarantee |
18+
| Aletheia verification checks | Verification pipeline produces sound results | Rhodibot extraction depends on correct checks |
19+
| Quantum mechanics proofs | Extend QuantumMechanicsExact.v coverage | Existing proofs are partial |
20+
21+
## Recommended Prover
22+
23+
**Coq** — Existing proof infrastructure is in Coq. The `y_not_cno` Admitted needs to be closed in Coq. Aletheia (Rust) verification would benefit from an **Idris2** ABI layer.
24+
25+
## Priority
26+
27+
**MEDIUM** — Has existing proof infrastructure with one known gap. The Admitted y_not_cno is a concrete, closable proof obligation. Aletheia verification correctness is more important long-term.
28+
29+
## Template ABI Cleanup (2026-03-29)
30+
31+
Template ABI removed -- was creating false impression of formal verification.
32+
The removed files (Types.idr, Layout.idr, Foreign.idr) contained only RSR template
33+
scaffolding with unresolved {{PROJECT}}/{{AUTHOR}} placeholders and no domain-specific proofs.

TEST-NEEDS.md

Lines changed: 59 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,59 @@
1+
# TEST-NEEDS.md — maa-framework
2+
3+
> Generated 2026-03-29 by punishing audit.
4+
5+
## Current State
6+
7+
| Category | Count | Notes |
8+
|-------------|-------|-------|
9+
| Unit tests | 0 | No inline tests in source |
10+
| Integration | 3 | absolute-zero FFI integration_test.zig, aletheia FFI integration_test.zig, rhodibot integration_tests.rs |
11+
| E2E | 0 | None |
12+
| Benchmarks | 1 | aletheia/benches/verification_benchmark.rs — uses std::time, not criterion (manual benchmark, not automated) |
13+
14+
**Source modules:** ~23 across 2 subsystems. absolute-zero: brainfuck interpreter, whitespace interpreter, main + ABI/FFI. aletheia: checks, config, main, output, types + rhodibot + rhodium-pipeline + ABI/FFI.
15+
16+
## What's Missing
17+
18+
### P2P (Property-Based) Tests
19+
- [ ] absolute-zero: arbitrary brainfuck program fuzzing (already has fuzz target, good)
20+
- [ ] aletheia: arbitrary repo structure verification fuzzing
21+
- [ ] Config parsing: property tests for all config formats
22+
23+
### E2E Tests
24+
- [ ] absolute-zero: compile -> execute -> verify program output
25+
- [ ] aletheia: full RSR verification pipeline (scan repo -> check rules -> report)
26+
- [ ] rhodibot: full bot operation cycle
27+
- [ ] rhodium-pipeline: extraction pipeline end-to-end
28+
29+
### Aspect Tests
30+
- **Security:** No tests for aletheia bypass (can a repo trick the verifier?), rhodibot credential handling
31+
- **Performance:** Benchmark exists but is manual (std::time), not integrated into CI, not criterion-based
32+
- **Concurrency:** No tests for parallel verification of multiple repos
33+
- **Error handling:** No tests for malformed repos, missing files, invalid configurations
34+
35+
### Build & Execution
36+
- [ ] `cargo test` for all Rust crates
37+
- [ ] `zig build test` for FFI tests
38+
- [ ] `cargo fuzz` for absolute-zero fuzz targets
39+
40+
### Benchmarks Needed
41+
- [ ] Verification speed per repo size/complexity (aletheia)
42+
- [ ] Brainfuck/whitespace interpreter throughput (absolute-zero)
43+
- [ ] rhodibot processing rate
44+
- [ ] Pipeline extraction throughput
45+
46+
### Self-Tests
47+
- [ ] aletheia: verify itself against RSR standards
48+
- [ ] Config schema validation
49+
- [ ] ABI version agreement
50+
51+
## Priority
52+
53+
**HIGH.** An RSR compliance verification framework that cannot verify itself is the definition of irony. 23 source modules with 0 unit tests. The 3 integration tests are a start but cover only FFI seams. The benchmark is manual and not CI-integrated. Fuzz targets for absolute-zero are good but need complementary structured tests.
54+
55+
## FAKE-FUZZ ALERT
56+
57+
- `tests/fuzz/placeholder.txt` is a scorecard placeholder inherited from rsr-template-repo — it does NOT provide real fuzz testing
58+
- Replace with an actual fuzz harness (see rsr-template-repo/tests/fuzz/README.adoc) or remove the file
59+
- Priority: P2 — creates false impression of fuzz coverage

absolute-zero/CURRENT-STATUS.md

Lines changed: 0 additions & 125 deletions
This file was deleted.

0 commit comments

Comments
 (0)