Skip to content

ROADMAP.adoc

Latest commit

 

History

History
70 lines (63 loc) · 3.85 KB

ROADMAP.adoc

File metadata and controls

70 lines (63 loc) · 3.85 KB
Raw

VeriSimiser Roadmap

Table of Contents

Phase 0: Scaffold (COMPLETE)

  • ✓ RSR template with full CI/CD

  • ✓ CLI with subcommands (init, start, drift, provenance, history, status, octad, doctor, gc, validate, version)

  • ✓ Manifest parser (verisimiser.toml with [tier1]/[tier2]/[retention] config)

  • ✓ Concerns octad fixed canonical (ADR-0004): Data, Metadata, Provenance, Lineage, Constraints, AccessControl, Temporal, Simulation

  • ✓ Tier 1 data types per concern (ProvenanceEntry, TemporalVersion, DriftReport, AccessPredicate)

  • ✓ ABI module stubs (Idris2 + Zig FFI) and domain-tagged compute_hash

  • ✓ Drift categories pinned (ADR-0003): input / distance / threshold per category

  • ✓ README rewritten around concerns octad (V-L1-A2, #20)

Phase 1: PostgreSQL Tier 1 MVP — concerns layered onto your DB

  • ❏ PostgreSQL logical replication interception (Data / Metadata feed)

  • ❏ Provenance sidecar (SQLite) — write-path observer with SHA-256 hash chain

  • ❏ Lineage DAG writer — acyclic edges enforced via recursive CTE (ADR-0005)

  • ❏ Temporal versioning writer — verisimdb_temporal_versions, point-in-time queries

  • ❏ AccessControl policy evaluator — prefix-typed principals, deny-wins (ADR-0007)

  • ❏ Constraints / drift detection — read-path observer; eight categories (ADR-0003)

  • ✓ Constraints category 1 of 8: Temporal drift detector (V-L1-E2 / #49)

  • ❏ Constraints categories 2–8 of 8: Structural, Semantic, Statistical, Referential, Provenance, Spatial, Embedding

  • ✓ Idris2 ABI proofs: sidecar isolation (Octad), hash-chain integrity (HashChain), version ordering (Version), lineage acyclicity (Lineage) — machine-checked by provable.yml (the *.idr are abstract models of the invariants; live-DB enforcement of them is still TODO below)

  • ❏ Zig FFI bridge: database connection, sidecar operations, VCL-total queries

  • ❏ End-to-end test: PostgreSQL → verisimiser concerns → VCL-total query

Phase 2: Multi-Backend Support

  • ❏ SQLite interception via sqlite3_update_hook / WAL monitoring

  • ❏ MongoDB interception via change streams

  • ❏ Redis interception via keyspace notifications

  • ❏ MySQL interception via binlog CDC

  • ❏ Application-level middleware / ORM hooks

  • ❏ Backend-agnostic interception trait abstraction

  • ❏ Per-backend integration tests

Phase 3: Tier 2 Overlays

  • ❏ Graph overlay (RDF triples / property graph edges)

  • ❏ Vector overlay (HNSW embedding similarity search)

  • ❏ Tensor overlay (ndarray multi-dimensional numeric data)

  • ❏ Semantic overlay (CBOR type annotations + proof blobs)

  • ❏ Document overlay (Tantivy full-text search)

  • ❏ Spatial overlay (R-tree geospatial coordinates)

  • ❏ Independent enable/disable per overlay via manifest

Phase 4: VCL-total Integration

  • ❏ VCL-total type-safe query parsing

  • ❏ Cross-tier queries (Tier 1 + Tier 2 in single query)

  • ❏ TypedQLiser integration for compile-time query validation

  • ❏ Query planner for multi-sidecar operations

  • ❏ Performance benchmarks: overhead of augmentation layer

Phase 5: Production Hardening

  • ❏ Retention policies (auto-prune temporal history)

  • ❏ Sidecar compaction and garbage collection

  • ❏ Concurrent access safety (multi-writer provenance chains)

  • ❏ Backup and restore for sidecars

  • ❏ Monitoring and alerting integration

  • ❏ Error recovery and graceful degradation

  • ❏ Shell completions (bash, zsh, fish)

Phase 6: Ecosystem

  • ❏ PanLL panel for drift monitoring dashboard

  • ❏ BoJ-server cartridge (MCP integration)

  • ❏ SqueakWell integration (database recovery via cross-modal constraint propagation)

  • ❏ Migration tooling: Tier 1 → Tier 2 → full VeriSimDB

  • ❏ Publish to crates.io

  • ❏ Chainguard container image