|
2 | 2 |
|
3 | 3 | > Generated 2026-03-29 by punishing audit. |
4 | 4 |
|
5 | | -## Current State |
| 5 | +## Current State — Updated 2026-04-04 |
6 | 6 |
|
7 | 7 | | Category | Count | Notes | |
8 | 8 | |-------------|-------|-------| |
9 | 9 | | Unit tests | ~8 | echidna: test_agda_backend.rs, test_neural_integration.rs, ffi_integration_test.rs, prover tests (unified_test.ts, prover_test.ts). llm-antidote: test_suite.py | |
10 | 10 | | Integration | ~5 | echidna: integration_test.sh, Zig core_native_test.zig, integration_test.zig. llm-unify: e2e_test.sh | |
11 | | -| E2E | 1 | llm-unify e2e_test.sh | |
12 | | -| Benchmarks | 4 | echidna: proof_benchmarks.rs, benchmark.zig, overlay_benchmark.zig. llm-antidote: benchmark.py | |
| 11 | +| E2E | 3 | llm-unify e2e_test.sh, echidna tests/e2e_proof_pipeline.rs (29 tests), llm-unify-core tests/e2e_routing_test.rs (10 tests) | |
| 12 | +| P2P/Property | 31 | echidna tests/neural_property_tests.rs — embedding/dispatch/trust/hash/axiom/prover | |
| 13 | +| Aspect | 32 | echidna tests/security_aspect_tests.rs — forgery/injection/escalation/axiom/integrity | |
| 14 | +| Concurrency | 27 | echidna tests/concurrency_test.rs — parallel factory/routing/trust/hash/agent/axiom | |
| 15 | +| Benchmarks | 5 | echidna: proof_benchmarks.rs, routing_benchmarks.rs (7 groups), benchmark.zig, overlay_benchmark.zig. llm-antidote: benchmark.py | |
13 | 16 |
|
14 | 17 | **Source modules:** ~337 across 3 satellite groups. neurosymbolic/echidna: ~104 Rust src + Idris2 ABI + Zig FFI + Julia. foundation-models: llm-antidote, llm-unify, llm-unify-core. agentic: elegant-state, conative-gating, agentic-scm. |
15 | 18 |
|
16 | | -## What's Missing |
| 19 | +## What's Missing (Remaining After 2026-04-04 Session) |
17 | 20 |
|
18 | | -### P2P (Property-Based) Tests |
19 | | -- [ ] echidna proof engine: property tests for proof soundness (no invalid proof accepted) |
20 | | -- [ ] Neural integration: property tests for embedding consistency |
21 | | -- [ ] LLM antidote: adversarial input property tests |
22 | | -- [ ] Prover backends: equivalence property tests across prover implementations |
| 21 | +### Completed in 2026-04-04 CRG C Blitz ✓ |
23 | 22 |
|
24 | | -### E2E Tests |
25 | | -- [ ] echidna: full proof request -> prover selection -> proof generation -> verification |
26 | | -- [ ] llm-unify: request -> routing -> model inference -> response normalization |
27 | | -- [ ] agentic: agent lifecycle (create -> plan -> execute -> evaluate) |
| 23 | +- [x] echidna E2E: full proof request → prover selection → proof generation → verification (`tests/e2e_proof_pipeline.rs`) |
| 24 | +- [x] llm-unify E2E: request → routing → normalisation → fallback (`crates/llm-unify-core/tests/e2e_routing_test.rs`) |
| 25 | +- [x] P2P property tests: embedding, dispatch, trust monotonicity, hash stability, axiom ordering (`tests/neural_property_tests.rs`) |
| 26 | +- [x] Security aspect tests: forgery, injection, escalation, axiom sanitisation, integrity (`tests/security_aspect_tests.rs`) |
| 27 | +- [x] Concurrency tests: parallel factory, routing, trust, hashing, agent, axiom (`tests/concurrency_test.rs`) |
| 28 | +- [x] Routing benchmarks: decision latency, axiom throughput, trust computation, factory instantiation, agentic planning, BLAKE3 (`benches/routing_benchmarks.rs`) |
| 29 | + |
| 30 | +### Still Missing |
| 31 | + |
| 32 | +- [ ] Agentic E2E: agent lifecycle (create → plan → execute → evaluate) for elegant-state, conative-gating |
| 33 | +- [ ] LLM antidote adversarial property tests — NOTE: test_suite.py is semi-manual and Python (banned). Needs rewrite in Julia or Rust. |
28 | 34 | - [ ] Cross-satellite: echidna proof + llm-unify inference in combined workflow |
| 35 | +- [ ] Fuzz harness: replace `tests/fuzz/placeholder.txt` with a real cargo-fuzz harness |
29 | 36 |
|
30 | | -### Aspect Tests |
31 | | -- **Security:** No tests for proof forgery, model injection in llm-unify, agent privilege escalation |
32 | | -- **Performance:** Benchmarks exist for echidna (good) and llm-antidote. Missing: llm-unify latency, agentic execution time |
33 | | -- **Concurrency:** No tests for parallel proof generation, concurrent model inference, agent contention |
34 | | -- **Error handling:** No tests for prover timeout, model unavailability, malformed proof input, invalid agent state |
| 37 | +### P2P (Property-Based) Tests — Remaining |
| 38 | +- [ ] LLM antidote: adversarial input property tests (blocked: Python banned, needs Julia rewrite) |
| 39 | +- [ ] Prover backends: equivalence property tests across all 49 prover implementations (coverage increase) |
35 | 40 |
|
36 | 41 | ### Build & Execution |
37 | 42 | - [ ] `cargo test` for echidna Rust |
|
0 commit comments