|
| 1 | +# TEST-NEEDS: verisimdb |
| 2 | + |
| 3 | +## Current State |
| 4 | + |
| 5 | +| Category | Count | Details | |
| 6 | +|----------|-------|---------| |
| 7 | +| **Source modules** | 18 | ReScript VQL (10: Bidir, Circuit, Context, Error, Explain, Parser, ProofObligation, Subtyping, TypeChecker, Types), Registry (4: KRaftCluster, KRaftSerializer, MetadataLog, Registry), Parser_test, 3 Idris2 ABI | |
| 8 | +| **Unit tests** | 1 file | VQLParser_test.res (~110 test/assert references) | |
| 9 | +| **Integration tests** | 1 file | integration_test.rs (0 #[test] -- may be stub) | |
| 10 | +| **E2E tests** | 0 | None | |
| 11 | +| **Benchmarks** | 2 files | modality_benchmarks.rs (104 bench/criterion refs), src/lib.rs | |
| 12 | + |
| 13 | +## What's Missing |
| 14 | + |
| 15 | +### P2P Tests (CRITICAL) |
| 16 | +- [ ] No tests for VQL type checker <-> subtyping <-> proof obligation pipeline |
| 17 | +- [ ] No tests for Registry <-> KRaft cluster interaction |
| 18 | +- [ ] No tests for bidirectional type inference (VQLBidir) |
| 19 | + |
| 20 | +### E2E Tests (CRITICAL) |
| 21 | +- [ ] No test that stores data, queries it via VQL, and validates results |
| 22 | +- [ ] No test for the full modality verification pipeline |
| 23 | +- [ ] No test for KRaft consensus with multiple nodes |
| 24 | + |
| 25 | +### Aspect Tests |
| 26 | +- [ ] **Security**: Database with no injection tests, no access control tests |
| 27 | +- [ ] **Performance**: Benchmark files exist -- need to verify they run |
| 28 | +- [ ] **Concurrency**: No concurrent read/write tests, no transaction isolation tests |
| 29 | +- [ ] **Error handling**: No tests for storage corruption, query timeout, cluster partition |
| 30 | + |
| 31 | +### Build & Execution |
| 32 | +- [ ] integration_test.rs has 0 #[test] -- appears to be a stub |
| 33 | +- [ ] No Idris2 ABI compilation test |
| 34 | + |
| 35 | +### Benchmarks Status |
| 36 | +- [x] modality_benchmarks.rs (104 criterion refs) -- appears genuine |
| 37 | +- [ ] No query throughput benchmark |
| 38 | +- [ ] No storage I/O benchmark |
| 39 | +- [ ] No cluster consensus latency benchmark |
| 40 | + |
| 41 | +### Self-Tests |
| 42 | +- [ ] No database self-consistency check |
| 43 | +- [ ] No `verisimdb --self-test` mode |
| 44 | + |
| 45 | +## FLAGGED ISSUES |
| 46 | +- **A DATABASE with 1 test file** -- VQLParser_test.res covers parsing but nothing else |
| 47 | +- **integration_test.rs is a STUB** with 0 actual test functions |
| 48 | +- **Registry/KRaft (distributed consensus) has 0 tests** -- consensus code is untested |
| 49 | +- **VQLBidir, VQLCircuit, VQLExplain, VQLProofObligation all have 0 tests** |
| 50 | +- **Benchmarks appear real** (104 criterion references) -- one bright spot |
| 51 | + |
| 52 | +## Priority: P0 (CRITICAL) |
0 commit comments