feat(aether-arena): ADR-149 Spatial-Intelligence Benchmark — scorer + CI harness gate

.claude-flow/horizons/aether-arena-aa.json

@@ -0,0 +1,119 @@
+{
+  "id": "aether-arena-aa",
+  "name": "AetherArena (AA) — Official Spatial-Intelligence Benchmark",
+  "adr": "ADR-149",
+  "adrPath": "docs/adr/ADR-149-public-community-leaderboard-huggingface.md",
+  "status": "Accepted",
+  "initializedDate": "2026-05-30",
+  "targetDate": "2026-08-31",
+  "exitCriteria": "Benchmark INFRASTRUCTURE done, tested, CI-gated, deploy-ready: aa_score_runner.rs passes deterministic fixture test; CI harness-gate green on every PR; aether-arena repo scaffold committed (README four-part framing + aa-submission.toml schema + VERIFY.md); public smoke split committed; HF Space lifecycle skeleton deployed; signed Parquet ledger functional; RuView baseline PCK@20 ~2.5% entered; ADR-149 §7 acceptance test (five-step stranger test) passes. NOTE: ML SOTA (MM-Fi PCK@20 ~72%) is a separate long-running stretch goal blocked on ADR-079 camera-ground-truth — it is NOT an infra exit criterion.",
+  "baselineState": {
+    "adrStatus": "Accepted, committed 2026-05-30",
+    "scorerCode": "ruview_metrics.rs + ablation.rs + proof.rs exist in wifi-densepose-train; aa_score_runner.rs not yet created",
+    "aetherArenaRepo": "does not exist yet — needs user authorization to create ruvnet/aether-arena public repo",
+    "hfSpace": "does not exist yet — needs HF_TOKEN and user authorization to deploy ruvnet/aether-arena HF Space",
+    "smokeDataset": "not committed",
+    "resultsLedger": "not created",
+    "ruviewBaseline": "PCK@20 ~2.5% self-reported, not formally entered",
+    "ciGate": "not added to workflow"
+  },
+  "milestones": {
+    "m1": {
+      "name": "ADR-149 Accepted + committed",
+      "status": "DONE",
+      "completedDate": "2026-05-30",
+      "completionCriteria": "ADR-149 file committed to docs/adr/ with status Accepted",
+      "notes": "Done this session. File at docs/adr/ADR-149-public-community-leaderboard-huggingface.md"
+    },
+    "m2": {
+      "name": "Deterministic scorer runner bin (aa_score_runner.rs)",
+      "status": "NOT_STARTED",
+      "completionCriteria": "aa_score_runner.rs compiles, runs ruview_metrics on a committed fixture, emits RuViewTier + SHA-256 proof hash, mirrors existing *_proof_runner.rs pattern; cargo test passes",
+      "estimatedEffort": "3-5 days",
+      "owner": "wifi-densepose-train crate or new aa-scorer crate"
+    },
+    "m3": {
+      "name": "CI harness-gate: GitHub Actions workflow",
+      "status": "NOT_STARTED",
+      "completionCriteria": "A GitHub Actions workflow runs aa_score_runner on every PR as a build gate; PR fails if scorer fails determinism check; workflow committed and green",
+      "estimatedEffort": "2-3 days",
+      "dependency": "M2 must be done first"
+    },
+    "m4": {
+      "name": "aether-arena repo scaffold",
+      "status": "NOT_STARTED",
+      "completionCriteria": "ruvnet/aether-arena repo created with: README (four-part framing: Public leaderboard / Private eval split / Open scorer / Signed results); aa-submission.toml manifest schema; VERIFY.md (ADR-149 §7 stranger acceptance test); neutrality/governance section (§2.8); contribution guide",
+      "estimatedEffort": "3-5 days",
+      "blockers": ["Needs user authorization to create public ruvnet/aether-arena repo on GitHub"]
+    },
+    "m5": {
+      "name": "Public smoke split committed + private MM-Fi held-out split prep",
+      "status": "NOT_STARTED",
+      "completionCriteria": "Public smoke split committed to aether-arena repo (stranger can score locally); private MM-Fi held-out split prepared under non-public path with CC BY-NC 4.0 attribution; Wi-Pose explicitly excluded from v0",
+      "estimatedEffort": "5-7 days",
+      "riskNotes": "MM-Fi CC BY-NC 4.0: AA must remain non-commercial and carry MM-Fi attribution; raw frames stay in private split; only derived CSI features + scores may be exposed"
+    },
+    "m6": {
+      "name": "HF Space (Gradio) skeleton",
+      "status": "BLOCKED",
+      "completionCriteria": "HF Space deployed at ruvnet/aether-arena with submission lifecycle (submitted->validated->quarantined->smoke_scored->full_scored->published/rejected); sandboxed scorer container wired; basic leaderboard table rendered",
+      "estimatedEffort": "7-10 days",
+      "blockers": [
+        "Needs HF_TOKEN — check .env for HF_TOKEN or HUGGINGFACE_TOKEN",
+        "Needs user authorization to create/deploy ruvnet/aether-arena HF Space (outward-facing public deployment)"
+      ]
+    },
+    "m7": {
+      "name": "Signed append-only Parquet results ledger",
+      "status": "NOT_STARTED",
+      "completionCriteria": "HF dataset ruvnet/aether-arena-results created; append-only Parquet ledger with signed rows; determinism_gate enforced; no row can be silently edited",
+      "estimatedEffort": "3-5 days",
+      "ledgerSchema": "submitter, model_ref, category, feature_set, tier, pck20, oks, mota, vitals_bpm_err, latency_p50, latency_p95, privacy_leakage, cross_room_deg, proof_sha256, scored_at, harness_version",
+      "dependency": "M6 must be scaffolded first"
+    },
+    "m8": {
+      "name": "RuView baseline entry + public launch",
+      "status": "NOT_STARTED",
+      "completionCriteria": "RuView wifi-densepose-pretrained baseline entered (honest PCK@20 ~2.5%); ADR-149 §7 five-step stranger acceptance test passes; v0 live with Presence + Pose + Edge-latency + Determinism categories active; Privacy and Cross-room shown as gated/coming-soon",
+      "estimatedEffort": "3-5 days",
+      "dependency": "M4+M5+M6+M7 complete",
+      "notes": "ML SOTA improvement (PCK@20 ~72%) is a SEPARATE stretch goal blocked on ADR-079 P7-P9 camera ground truth. NOT a blocker for infra launch."
+    }
+  },
+  "activeMilestone": "m2",
+  "completedMilestones": ["m1"],
+  "knownRisks": [
+    "HF_TOKEN not confirmed present in .env — check before M6 work begins",
+    "ruvnet/aether-arena public repo creation is outward-facing — needs explicit user authorization",
+    "MM-Fi CC BY-NC 4.0: AA must stay legally non-commercial and brand-distinct from commercial RuView product; or seek MM-Fi commercial grant before any paid tier",
+    "Wi-Pose has research-use-only terms (no redistribution grant) — excluded from v0; revisit only if terms are clarified with authors",
+    "HF Space free CPU tier may be too slow for Candle/tch inference pipeline — may need ZeroGPU or self-hosted scorer on cognitum-20260110 GCloud A100/L4",
+    "ADR-079 camera-ground-truth (PCK@20 SOTA) is P7-P9 pending — NOT an infra blocker; must not be conflated with AA infra completion",
+    "Neutrality/governance risk: RuView seeded the scorer — must be demonstrably scored through the same public pipeline as any other entrant (§2.8 controls)"
+  ],
+  "driftSignals": {
+    "timeline": "GREEN — just initialized, no timeline pressure yet",
+    "scope": "GREEN — scope locked at four-part structure per ADR-149 §2 decision",
+    "approach": "GREEN — reuse pattern (existing ruview_metrics + proof.rs) confirmed in ADR-149",
+    "dependency": "YELLOW — HF_TOKEN and ruvnet/aether-arena repo authorization are external blockers with unknown ETA",
+    "priority": "GREEN — active feature branch feat/adr-136-146-streaming-engine in progress; AA infra can proceed in parallel on its own branch"
+  },
+  "stretchGoals": {
+    "sotaML": "MM-Fi PCK@20 SOTA ~72% — separate ML effort blocked on ADR-079 P7-P9 camera-ground-truth data collection; NOT an infra exit criterion",
+    "privacyAxis": "ADR-145 §10 membership-inference attacker — activate Privacy leaderboard axis once attacker is implemented and published",
+    "crossRoom": "Multi-room held-out split — activate Cross-room generalization axis",
+    "multiOrgSteering": "Invite co-maintainers from other projects once >=N external entries land"
+  },
+  "sessionHistory": [
+    {
+      "date": "2026-05-30",
+      "type": "initialization",
+      "accomplished": [
+        "ADR-149 Accepted and committed to docs/adr/",
+        "Horizon record initialized in .claude-flow/horizons/aether-arena-aa.json",
+        "Memory stored in horizons namespace under key horizon-aether-arena-aa",
+        "Session check-in record stored in horizon-sessions namespace"
+      ]
+    }
+  ]
+}

.github/workflows/aether-arena-harness.yml

@@ -0,0 +1,94 @@
+name: AetherArena harness gate (ADR-149)
+
+# Runs the AetherArena scoring harness as a PR build gate. Every PR that touches
+# the scorer, the metrics, or the benchmark scaffold must keep the deterministic
+# score hash stable (ADR-149 §2.5 determinism_gate). If the scoring maths changes,
+# the hash moves and this gate fails until `expected_score.sha256` is regenerated
+# and reviewed — so scorer drift can never land silently.
+#
+# This is the "a PR that runs the harness as part of the build process" requirement.
+
+on:
+  pull_request:
+    paths:
+      - 'v2/crates/wifi-densepose-train/src/ruview_metrics.rs'
+      - 'v2/crates/wifi-densepose-train/src/ablation.rs'
+      - 'v2/crates/wifi-densepose-train/src/bin/aa_score_runner.rs'
+      - 'aether-arena/**'
+      - '.github/workflows/aether-arena-harness.yml'
+  push:
+    branches: ['feat/adr-149-aether-arena']
+  workflow_dispatch:
+
+permissions:
+  contents: read
+  pull-requests: write
+
+jobs:
+  harness-gate:
+    name: Run AA scorer harness (determinism gate)
+    runs-on: ubuntu-latest
+    defaults:
+      run:
+        working-directory: v2
+    steps:
+      - uses: actions/checkout@v4
+
+      - name: Install Rust toolchain
+        run: rustup show && rustc --version
+
+      - name: Cache cargo
+        uses: actions/cache@v4
+        with:
+          path: |
+            ~/.cargo/registry
+            ~/.cargo/git
+            v2/target
+          key: aa-harness-${{ runner.os }}-${{ hashFiles('v2/Cargo.lock') }}
+
+      # 1. Build the pure-Rust scorer (no torch / no GPU → fast PR gate).
+      - name: Build AA score runner
+        run: cargo build -p wifi-densepose-train --bin aa_score_runner --no-default-features
+
+      # 2. Determinism gate: the committed expected hash must still match. A
+      #    non-zero exit here fails the PR.
+      - name: Run determinism gate
+        run: cargo run -q -p wifi-densepose-train --bin aa_score_runner --no-default-features
+
+      # 3. Repeatability analysis (witness chain): the harness must produce one
+      #    identical proof hash across many runs — any nondeterminism fails here.
+      - name: Repeatability analysis (16 runs)
+        run: cargo run -q -p wifi-densepose-train --bin aa_score_runner --no-default-features -- --repeat 16
+
+      # 4. Real-scoring smoke: score a sample prediction against the public smoke
+      #    split, exercising the actual model-scoring path (not just the fixture).
+      - name: Real-scoring smoke test
+        run: |
+          cargo run -q -p wifi-densepose-train --bin aa_score_runner --no-default-features -- \
+            --split ../aether-arena/fixtures/smoke_split.json \
+            --pred  ../aether-arena/fixtures/smoke_pred.json --json
+
+      # 5. Witness ledger chain integrity: the append-only results ledger must
+      #    verify (every prev_hash link + row_hash intact = no silent edits).
+      - name: Verify witness ledger chain
+        working-directory: aether-arena/ledger
+        run: python3 ledger_tools.py verify
+
+      # 6. Emit the witness row + repeatability into the PR run summary.
+      - name: Witness row → job summary
+        if: always()
+        run: |
+          ROW=$(cargo run -q -p wifi-densepose-train --bin aa_score_runner --no-default-features -- --json)
+          REP=$(cargo run -q -p wifi-densepose-train --bin aa_score_runner --no-default-features -- --repeat 16)
+          {
+            echo "## AetherArena harness gate (witness chain)"
+            echo ""
+            echo "Deterministic witness (ADR-149 §2.2 / proof + repeatability):"
+            echo '```json'
+            echo "$ROW"
+            echo "$REP"
+            echo '```'
+            echo ""
+            echo "If the determinism gate failed, the scoring maths changed: regenerate with"
+            echo '`cargo run -p wifi-densepose-train --bin aa_score_runner --no-default-features -- --generate-hash > aether-arena/fixtures/expected_score.sha256` and review the diff.'
+          } >> "$GITHUB_STEP_SUMMARY"

.github/workflows/ruview-swarm-ci.yml

@@ -60,8 +60,14 @@ jobs:
     runs-on: ubuntu-latest
     steps:
       - uses: actions/checkout@v4
+      # v2/rust-toolchain.toml pins channel "1.89" with profile "minimal" (no
+      # clippy). dtolnay@stable installs clippy on the floating "stable"
+      # toolchain, but the override makes cargo use the separate "1.89"
+      # toolchain — so `cargo clippy` errors "cargo-clippy is not installed for
+      # 1.89". Install clippy on the pinned toolchain that cargo actually uses.
       - uses: dtolnay/rust-toolchain@stable
         with:
+          toolchain: "1.89"
           components: clippy
       - name: Cache cargo
         uses: actions/cache@v4

.gitignore

@@ -261,3 +261,10 @@ v2/crates/rvcsi-node/*.node
 v2/crates/rvcsi-node/binding.js
 v2/crates/rvcsi-node/binding.d.ts
 v2/crates/rvcsi-node/npm/
+
+# AetherArena private optimization staging — never published until reviewed
+aether-arena/staging/
+
+# MM-Fi benchmark dataset archives — large data, fetch separately, never commit
+assets/MM-Fi/E0*.zip
+assets/MM-Fi/*.zip

CHANGELOG.md

@@ -7,7 +7,16 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
+### Fixed
+- **Person count no longer pinned to 1 — addresses #803.** The aggregate occupancy reported by the sensing server was derived from `smoothed_person_score`, an EMA-smoothed *activity* score (amplitude variance / motion / spectral energy). That score saturates near a single occupant — one moving person maxes it out — so it cannot discriminate occupancy *count* and stayed clamped at 1 across S3/C6 and the Python/Docker/Rust servers. Meanwhile the count-aware per-node estimates the ESP32 paths already compute (firmware `n_persons`, and the DynamicMinCut `corr_persons`) were stashed in `NodeState::prev_person_count` and then **discarded** by the aggregator (same dead-wiring class as #872). The aggregator now takes `max(activity_count, node_max)` via a unit-tested `aggregate_person_count` helper, so a node positively estimating 2–3 occupants is surfaced instead of overwritten. The fix can only ever *raise* the count when a node reports more people, so the single-occupant case is provably never inflated (regression-guarded by test). **Second half:** the pure-CSI per-node path itself clamped its own estimate — the DynamicMinCut occupancy (`estimate_persons_from_correlation`, 0–3) was mapped to a score via `corr_persons / 3.0`, putting 2 people at 0.667, *just under* the 0.70 up-threshold of `score_to_person_count`, so the per-node count never climbed past 1 (so `node_max` was also stuck at 1 for CSI-only nodes). Replaced it with a threshold-aligned `corr_persons_to_score` mapping (1→0.40, 2→0.74, 3→0.96) whose steady state round-trips back to the same count through the EMA + hysteresis, while still gating transient noise. A convergence test replays the exact EMA loop to prove min-cut=2 now reports 2 (and documents that the old `/3.0` mapping reported 1). Full multi-person accuracy still depends on the underlying estimator quality; this removes the two server-side clamps that masked it. 586 sensing-server tests pass.
+- **MQTT publisher now actually runs (`--mqtt`) — closes #872.** The `--mqtt*` flags were defined only in `cli::Args` (dead code, referenced nowhere) while the binary parses a *separate* `main::Args` with no mqtt fields, and `main.rs` never started the `mqtt::` publisher — so MQTT/Home-Assistant integration was completely unwired (`--mqtt` errored as an unexpected argument, and even with the Docker image's `--features mqtt` build the publisher never ran). Earlier attempts chased a Docker *rebuild*; the real cause was disconnected *code*. Extracted the flags into a shared `cli::MqttArgs` (`#[command(flatten)]` into both structs), spawn the publisher on `--mqtt`, and bridge the JSON sensing broadcast into the typed `VitalsSnapshot` stream with a defensive `serde_json::Value` mapping. Verified end-to-end against `mosquitto`: 20 HA auto-discovery entities + live state (presence/person-count/…). 577 (default) / 580 (`--features mqtt`) tests pass.
+
 ### Added
+- **WiFi-CSI pose: efficiency frontier + per-room calibration service** (ADR-150 §3.2–3.6). Two beyond-SOTA results on the MM-Fi benchmark, plus the deployment mechanism that resolves real-world generalization:
+  - **Efficiency frontier** — a **75 K-param model beats published SOTA** (74.3% vs MultiFormer 72.25% torso-PCK@20); every config from `micro` up is Pareto-dominant (smaller *and* more accurate than prior work). Shipped a deployable **int4 edge model (~20 KB, verified 74.08%, 0.135 ms single-thread CPU)** — published at [`ruvnet/wifi-densepose-mmfi-pose/edge`](https://huggingface.co/ruvnet/wifi-densepose-mmfi-pose). See [`docs/benchmarks/wifi-pose-efficiency-frontier.md`](docs/benchmarks/wifi-pose-efficiency-frontier.md).
+  - **Generalization solved by few-shot calibration** — zero-shot cross-subject (~64%) and cross-environment (~10%) are *not* closeable by algorithms (CORAL, DANN, instance-norm, contrastive foundation-pretraining all tested, all failed) or by more training subjects (saturates ~64%). But **~100–200 labeled in-room samples recover SOTA-level pose**: cross-subject 64→76%, **cross-environment 10→73% (60% from just 5 samples)** — deployable as a **~11 KB per-room LoRA adapter** on a frozen shared base. Full empirical chain in ADR-150 §3.2–3.6.
+  - **Calibration service (complete, both model paths, cross-language verified)** — `aether-arena/calibration/`: `calibrate.py` (transformer model, `.npz` adapter) + `infer.py` (verified 3.09%→74.29% on an unseen MM-Fi room), **and `cog_calibrate.py`** which fits a `fc1.a/fc1.b/fc2.a/fc2.b` **safetensors** adapter for the deployed cog conv+MLP model (`pose_v1.safetensors`). Consumed by the Rust product engine: `InferenceEngine::with_adapter()` + `cog-pose-estimation run --config <cfg> --adapter <room.safetensors>`. Self-contained regression tests for both Python producers (`test_calibration.py`, `test_cog_calibration.py`) **plus a cross-language Rust integration test** that loads a real `cog_calibrate.py`-generated adapter fixture and asserts it activates + changes engine output. All green.
+- **Windows workspace build + test now green** (cross-platform fixes). `wifi-densepose-worldmodel` imported `tokio::net::UnixStream` unconditionally, so `cargo build/test --workspace` failed to compile on Windows (E0432) — now the OccWorld Unix-socket bridge is `#[cfg(unix)]`-gated with a clear non-unix fallback. And `wifi-densepose-bfld`'s `readme_quickstart_uses_canonical_public_api` test checked a multi-line `pipeline\n    .process` needle that never matched on a CRLF checkout — now normalizes line endings. Result: **2,682 workspace tests pass / 0 fail on Windows** (the pre-merge gate was previously unrunnable there).
 - **`ruview-swarm` crate (ADR-148)** — drone swarm control system with hierarchical-mesh topology, Raft consensus, MAPPO multi-agent reinforcement learning, and CSI sensing integration. 14 modules: topology (Raft/Gossip/Mesh), formation control (virtual-structure/leader-follower/Reynolds flocking), RRT-APF path planning, auction+FNN task allocation, MARL actor + PPO training loop, security (MAVLink v2 HMAC-SHA256 signing, UWB anti-spoofing, geofencing, Remote ID, FHSS anti-jamming), 10-state fail-safe machine, and SwarmOrchestrator. ITAR-gated coordination features (USML Category VIII(h)(12)) behind `itar-unrestricted` feature.
 - **Ruflo integration for `ruview-swarm`** — feature-gated (`ruflo`) AI-agent capability layer connecting to the claude-flow daemon: AgentDB mission memory (`memory_store`/`memory_search`), HNSW pattern learning (`agentdb_pattern-store`/`-search`), AIDefence MAVLink message scanning, and SONA intelligence trajectory hooks. `RufloBackend` trait with `HttpRufloBackend` (JSON-RPC 2.0) and `MockRufloBackend` implementations.