chore(sqlite): stateless storage refactor#4856

Draft

NathanFlurry wants to merge 27 commits intomainfrom

04-29-chore_sqlite_stateless_storage_refactor

Commits on Apr 29, 2026

chore(sqlite): stateless storage refactor
NathanFlurry
committed
feat: US-001 - Add NodeId type and accessor to rivet_pools::Pools
NathanFlurry
committed
feat: US-002 - Rename sqlite-storage crate to sqlite-storage-legacy
NathanFlurry
committed
feat: US-003 - Scaffold new sqlite-storage crate with pump/compactor module skeleton
NathanFlurry
committed
feat: US-004 - Add pump/keys.rs with new META sub-key layout
NathanFlurry
committed
feat: US-005 - Add pump/types.rs (DBHead minus next_txid) and pump/udb.rs (COMPARE_AND_CLEAR wrapper)
NathanFlurry
committed
feat: US-006 - Add pump/quota.rs with atomic-counter wrapper and SQLITE_MAX_STORAGE_BYTES
NathanFlurry
committed
feat: US-007 - Add pump/actor_db.rs with ActorDb struct and constructor
NathanFlurry
committed
feat: US-008 - Implement pump/read.rs (get_pages) with PIDX cache
NathanFlurry
committed
feat: US-009 - Implement pump/commit.rs (single-shot commit with quota cap and lazy first-commit init)
NathanFlurry
committed
feat: US-010 - Add pump/metrics.rs with sqlite_pump_* Prometheus metrics
NathanFlurry
committed
feat: US-011 - Add compactor/subjects.rs and compactor/publish.rs
NathanFlurry
committed
feat: US-012 - Add compactor/lease.rs with /META/compactor_lease take/check/release
NathanFlurry
committed
feat: US-013 - Add compactor/shard.rs with per-shard fold logic
NathanFlurry
committed
feat: US-014 - Add compactor/compact.rs with compact_default_batch and COMPARE_AND_CLEAR PIDX deletes
NathanFlurry
committed
feat: US-015 - Add compactor/worker.rs with start() UPS subscriber loop and lease lifecycle
NathanFlurry
committed
feat: US-016 - Wire metering rollup in compactor (UPS trigger payload + MetricKey emit)
NathanFlurry
committed
feat: US-017 - Add debug-only quota validation pass to compactor
NathanFlurry
committed
feat: US-018 - Add compactor/metrics.rs and register sqlite_compactor in run_config.rs
NathanFlurry
committed
feat: US-019 - Implement takeover.rs debug-only invariant scanner
NathanFlurry
committed
feat: US-020 - Wire publish_compact_trigger and throttle in ActorDb commit path
NathanFlurry
committed
feat: US-021 - Add actor_dbs HashMap to pegboard-envoy WS conn and wire SQLite request handlers
NathanFlurry
committed
feat: US-022 - Delete start_actor handler, active_actors HashMap, open/close/force_close call sites in pegboard-envoy
NathanFlurry
committed
feat: US-023 - Reduce stop_actor handler to actor_db cache eviction, clear /META/compactor_lease in pegboard actor-destroy
NathanFlurry
committed
feat: US-024 - Write new envoy-protocol vN.bare schema and bump PROTOCOL_VERSION constants
NathanFlurry
committed
feat: US-025 - Delete sqlite-storage-legacy crate
NathanFlurry
committed
feat: US-026 - Update engine/CLAUDE.md to match new design
NathanFlurry
committed