Skip to content

Commit fd809c6

Browse files
committed
docs(arm-discovery): map the splat-codebook → aerial → Wikidata wiring; jc resolves both aerial seams
Architecture synthesis (no new code — the seam already exists). Grounds the user's direction (wire the 10000^2 Gaussian-splat BLASGraph top-k as the aerial oracle for OWL/DOLCE+ SPO HHTL class/basin discovery -> deterministic Wikidata compression, adjacent to the jc EWA-sandwich splat) against real workspace artifacts. Finding (E-ARM-JC-RESOLVES-BOTH-SEAMS): aerial's two open seams both resolve to crates/jc (Jirak-Cartan): - CodebookDistance oracle <- jc builds + certifies the frozen [u32;dim^2] table offline: ewa_sandwich{,_3d} (splat Sigma-push-forward for ndarray::hpc::splat3d), sigma_codebook_probe (the rho=0.9973 source: 256-codebook R^2>=0.99 viability), pflug (CAM-PQ/HHTL Le-faithful). - D-ARM-7 Jirak floor <- jc::jirak (weak-dependence Berry-Esseen rate n^(p/2-1)). Float boundary = CAM-PQ doctrine end-to-end: float lives ONLY in jc's offline build+certify; it emits a frozen integer artifact; aerial's online path stays integer. The "deterministically compress Wikidata" claim is float-free at runtime. No new aerial dependency — the certified table feeds the existing MatrixDistance /CodebookDistance seam. - knowledge/splat-codebook-aerial-wikidata-compression.md: the full wiring map - EPIPHANIES: E-ARM-JC-RESOLVES-BOTH-SEAMS - STATUS_BOARD: D-ARM-7 engine pointer (jc::jirak), D-ARM-13 -> 33/33 + SIMD clause, new D-ARM-14 (splat-codebook oracle + Wikidata skeleton discovery) - aerial/codebook.rs: oracle doc names jc + the offline-float/online-integer boundary https://claude.ai/code/session_012SorR8UbtEvYmbX8cXftj7
1 parent 3a52974 commit fd809c6

5 files changed

Lines changed: 144 additions & 6 deletions

File tree

.claude/board/AGENT_LOG.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,11 @@
1+
## [Main thread / Opus] Splat-codebook ↔ aerial ↔ Wikidata wiring — jc resolves both aerial seams
2+
3+
**Branch:** claude/jolly-cori-clnf9 | **Files:** ADDED `.claude/knowledge/splat-codebook-aerial-wikidata-compression.md`; EPIPHANIES (E-ARM-JC-RESOLVES-BOTH-SEAMS); STATUS_BOARD (D-ARM-7 engine pointer, D-ARM-13 → 33/33 + SIMD clause, new D-ARM-14); `aerial/codebook.rs` oracle doc names jc + the float boundary; AGENT_LOG.
4+
5+
**Outcome:** ANALYSIS + doc (no new code — the seam already exists). User direction: wire the 10000² Gaussian-splat BLASGraph top-k as the aerial oracle for OWL/DOLCE+ SPO HHTL class/basin discovery → deterministic Wikidata compression, adjacent to jc (Jirak-Cartan) EWA-sandwich splat. Grounded it against real workspace artifacts (consult-before-guess): `crates/jc` is "Jirak-Cartan" ("candar"≈Cartan), holding `ewa_sandwich{,_3d}` (Pillars 9/9b: splat Σ-push-forward for `ndarray::hpc::splat3d`), `sigma_codebook_probe` (**the ρ=0.9973 source** — 256-codebook R²≥0.99 viability), `pflug` (Pillar 10: CAM-PQ/HHTL Lε-faithful), `jirak` (Pillar 5: weak-dep Berry-Esseen). FINDING (E-ARM-JC-RESOLVES-BOTH-SEAMS): aerial's two open seams — the production `CodebookDistance` oracle AND the D-ARM-7 Jirak floor — **both resolve to jc**. jc PROVES the codebook (builds + certifies the frozen `[u32;dim²]` table offline, float OK); aerial USES it online (integer) to discover the `wikidata-hhtl-load.md` skeleton (P279/P31 DAG + basins, DOLCE as axis template). Float boundary = CAM-PQ doctrine end-to-end: build offline (float), address online (integer); the runtime stays float-free. No new aerial dependency — pass the table through the existing `MatrixDistance` seam. Confirmed user's target-cpu point (AVX-512/AMX need native/x86-64-v4) — already in the SIMD commit. PR #436 updated.
6+
7+
---
8+
19
## [Main thread / Opus] D-ARM-13 SIMD seam — bitset SoA + ndarray::simd::U64x8 (AND+popcount)
210

311
**Branch:** claude/jolly-cori-clnf9 | **Files:** `crates/lance-graph-arm-discovery/` — ADDED `bitset.rs` (`RowMasks` row-bitset SoA), `simd.rs` (`popcount`/`and_popcount`, scalar default + `ndarray-simd` feature); rewired `aerial/extract.rs` (probe counts via `RowMasks`, not AoS rescan); `lib.rs`, `Cargo.toml` (`ndarray-simd` feature + optional ndarray path dep, `default-features=false` + `std`), `README.md`.

.claude/board/EPIPHANIES.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,16 @@
1+
## 2026-05-30 — E-ARM-JC-RESOLVES-BOTH-SEAMS — aerial's two open seams (the distance oracle AND the D-ARM-7 Jirak floor) both resolve to `crates/jc`; jc PROVES the splat codebook, aerial USES it to discover the DOLCE skeleton that compresses Wikidata
2+
3+
**Status:** FINDING (architecture; seams concrete, end-to-end pipeline is CONJECTURE). User framing: "gaussian-splat spatial blasgraph top-k 10000×10000 … for OWL/DOLCE+ SPO HHTL classes and basin via aerial+ to deterministically compress Wikidata … adjacent to JC Jirak[-Cartan] with EWA-sandwich gaussian splat."
4+
5+
The de-float (E-ARM-PROBE-IS-CODEBOOK-TOPK) left aerial with two open seams: a production `CodebookDistance` oracle, and the unimplemented D-ARM-7 Jirak significance floor (ISSUE ARM-JIRAK-FLOOR). **Both resolve to the same crate — `crates/jc` (Jirak-Cartan)** — and the grounding is already in the workspace, not invented:
6+
7+
- **Oracle ← jc.** `jc::ewa_sandwich{,_3d}` (Pillars 9/9b) certify the Gaussian-splat Σ-push-forward `J·W·Σ·Wᵀ·Jᵀ` for `ndarray::hpc::splat3d` — i.e. the 10000² BLASGraph spatial top-k that *builds* the codebook is correct. `jc::sigma_codebook_probe` is **literally where ρ=0.9973 comes from**: it measures a 256-codebook capturing the Σ-distribution at R²≥0.99 in log-Euclidean space. `jc::pflug` (Pillar 10) certifies the CAM-PQ/HHTL tree quantization is Lε-faithful (compression is faithful, not lossy-by-surprise). The frozen `[u32; dim²]` table feeds aerial's existing `MatrixDistance`/`CodebookDistance` seam — no new aerial dependency.
8+
- **Jirak floor ← jc.** `jc::jirak` (Pillar 5) is the weak-dependence Berry-Esseen engine: classical IID is wrong here (I-NOISE-FLOOR-JIRAK), the correct rate is `n^(p/2-1)`. D-ARM-7's significance gate derives its threshold from it.
9+
10+
**The float boundary is the punchline.** float lives ONLY in jc's offline build+certify (k-means, SPD/EWA math, Berry-Esseen sup-error); it runs once, emits a frozen integer artifact, and is never on aerial's online path. That is the CAM-PQ doctrine end-to-end — *build the codebook offline (float OK), address it online with integer codes* — and it makes the whole "deterministically compress Wikidata" claim float-free at runtime. Downstream: aerial discovers the OWL/DOLCE+ SPO HHTL classes + basins (the `specs/wikidata-hhtl-load.md` skeleton: P279/P31 DAG + basin assignment, DOLCE as the axis template), the Jirak floor decides which rules are significant enough to persist, and codebook-HHTL is the 16ⁿ bucket router. Full map: `.claude/knowledge/splat-codebook-aerial-wikidata-compression.md`. Cross-ref: jc pillars 5/9/9b/10, `wikidata-hhtl-load.md`, `ogit-owl-dolce-ontology-compartments.md`, `3DGS-HHTL-datalake-traversal-plan.md`, E-ARM-PROBE-IS-CODEBOOK-TOPK.
11+
12+
---
13+
114
## 2026-05-30 — E-ARM-PROBE-IS-CODEBOOK-TOPK — Aerial+'s reconstruction probe IS a codebook top-k; the autoencoder was a float approximation of a lookup the substrate already does exactly; de-floating it dissolves the determinism firewall
215

316
**Status:** FINDING (de-float shipped on `claude/jolly-cori-clnf9`, 28/28 tests, zero f32 in the discovery path). User-directed: "neither cam_pq nor any other crate uses (or should) float … all is deterministic [a,b] codebook distance, ρ=0.9973 spearman."

.claude/board/STATUS_BOARD.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -627,13 +627,14 @@ The missing UPSTREAM discovery leg. Today's proposers (curated L-docs + AST-extr
627627
| D-ARM-4 | ARM-truth → NARS-truth translator + Odoo `FeedProjector` impl | lance-graph-arm-discovery::translator | 200 | HIGH | **Partially shipped (branch)** | The translator substance landed early inside D-ARM-13: `translator::{arm_to_nars, NarsTruth, CandidateTriple, FeedProjector}` (verbatim paper §2/§3.3 mapping, 35/35 tests). REMAINING: the real Odoo `FeedProjector` (currently a `DebugProjector` stub emitting `implies`) + contract homing on D-ARM-1/2. Depends on D-ARM-1/2. |
628628
| D-ARM-5 | Hypothesis test: SpoStore round-trip, NARS revision, contradiction commit per The Click | lance-graph-arm-discovery::hypothesis | 350 | MED | **Queued** | depends on D-ARM-4; verifies `spo::truth::Contradiction` primitive exists |
629629
| D-ARM-6 | `RatificationQueue` ring buffer + corrections-to-#434 spec PR (`discovery_arc D=8`, `discovery_origin u8`) | lance-graph-arm-discovery::queue + #434 spec follow-up | 200 + spec | MED | **Queued** | depends on PR #434 D-MBX-A3 landing |
630-
| D-ARM-7 | Jirak-2016 weak-dependence significance thresholds (mandatory Stage A floor) | lance-graph-arm-discovery::jirak | 150 | HIGH | **Queued — HARD PREREQUISITE** | blocks D-ARM-3; cites I-NOISE-FLOOR-JIRAK. **ISSUE ARM-JIRAK-FLOOR (2026-05-30, 3-savant review):** D-ARM-13 ships the Aerial proposer with NO Jirak floor (classical `min_support`/`min_confidence` only). MUST land before D-ARM-5 wires the proposer to a live `SpoStore`, else the substrate calcifies on thin-but-frequent noise (plan §11.1). |
630+
| D-ARM-7 | Jirak-2016 weak-dependence significance thresholds (mandatory Stage A floor) | lance-graph-arm-discovery::jirak | 150 | HIGH | **Queued — HARD PREREQUISITE** | blocks D-ARM-3; cites I-NOISE-FLOOR-JIRAK. **ISSUE ARM-JIRAK-FLOOR (2026-05-30, 3-savant review):** D-ARM-13 ships the Aerial proposer with NO Jirak floor (classical `min_support`/`min_confidence` only). MUST land before D-ARM-5 wires the proposer to a live `SpoStore`, else the substrate calcifies on thin-but-frequent noise (plan §11.1). **ENGINE EXISTS:** `jc::jirak` (Jirak-Cartan Pillar 5) is the weak-dependence Berry-Esseen rate (`n^(p/2-1)`); this deliverable is the *gate function* (rule → significant?) that derives its threshold from it — NOT a from-scratch Jirak impl. See E-ARM-JC-RESOLVES-BOTH-SEAMS + `splat-codebook-aerial-wikidata-compression.md`. |
631631
| D-ARM-8 | `Feed` + `FeedProjector` + window-size config + Odoo `account.move` projector example | lance-graph-arm-discovery::feed | 250 | MED | **Queued** | depends on D-ARM-2 |
632632
| D-ARM-9 | Aerial+ IPC client (feature-gated `arm-aerial`, NDJSON over Unix socket) | lance-graph-arm-discovery::proposer::aerial_ipc | 200 | MED | **Superseded by D-ARM-13** | The native in-process Aerial+ transcode (D-ARM-13, branch `claude/jolly-cori-clnf9`) replaces the need for the Python IPC client. The determinism-boundary rationale the IPC was designed for (keep the nondeterministic autoencoder out of the Rust path) is now met in-process via seed (`aerial::Rng`) + `aerial` feature gate + workspace `exclude`. Keep this row ONLY if a Python-only Aerial variant is later required; otherwise close as Abandoned-by-replacement. |
633633
| D-ARM-10 | `op_emitter::bucket_corpus` ratification filter (`confidence ≥ Ratified`) + 2 tests | lance-graph-ontology::op_emitter | 30 | HIGH | **Queued** | depends on D-ARM-1 |
634634
| D-ARM-11 | `style_recipe.rs` rule 8 — ArmDiscovered backing adds `DAtom::Compute` weight 2 (provisional) | lance-graph-ontology::style_recipe | 80 | MED | **Queued** | depends on D-ARM-1 |
635635
| D-ARM-12 | End-to-end pipeline test + bench (synthetic Odoo feed → all 5 stages → council micro-batch) | lance-graph-arm-discovery::tests + benches | 400 | MED | **Queued** | depends on Waves 1-6; informs OQ-ARM-2 + OQ-ARM-7 |
636-
| D-ARM-13 | **Aerial+ Rust transcode — deterministic codebook-probe backend** (float-free). The paper's `f32` denoising autoencoder is REPLACED by an integer `CodebookDistance` oracle (palette256 distance, ρ=0.9973 vs cosine): the reconstruction probe is a codebook top-k, not a softmax over float weights. Integer evidence counts + ppm gates + `TruthU8` (= CausalEdge64 wire). `AerialProposer` impl of `Proposer`. | lance-graph-arm-discovery::aerial | ~1.0K | HIGH | **Shipped (branch)** | branch `claude/jolly-cori-clnf9`; standalone zero-dep crate (excluded); 28/28 tests, clippy `-D warnings` clean; **zero f32 in the discovery path** (audit), float only at the `TruthValue`/`Triple` serialization edge. Bitwise-deterministic ⇒ joins the trunk; the nondeterminism firewall + D-ARM-9 IPC rationale are moot. v1 (autoencoder) superseded per the user's no-float directive. |
636+
| D-ARM-13 | **Aerial+ Rust transcode — deterministic codebook-probe backend** (float-free). The paper's `f32` denoising autoencoder is REPLACED by an integer `CodebookDistance` oracle (palette256 distance, ρ=0.9973 vs cosine): the reconstruction probe is a codebook top-k, not a softmax over float weights. Integer evidence counts + ppm gates + `TruthU8` (= CausalEdge64 wire). `AerialProposer` impl of `Proposer`. Count loop is a row-bitset SoA (`RowMasks`) → AND+popcount, routed through `ndarray::simd::U64x8` under the `ndarray-simd` feature. | lance-graph-arm-discovery::aerial | ~1.1K | HIGH | **Shipped (branch)** | branch `claude/jolly-cori-clnf9`; standalone zero-dep crate (excluded); **33/33** tests + clippy `-D warnings` clean on BOTH default (scalar) and `--features ndarray-simd`; **zero f32 in the discovery path** (audit), float only at the `TruthValue`/`Triple` serialization edge. Bitwise-deterministic ⇒ joins the trunk; the nondeterminism firewall + D-ARM-9 IPC rationale are moot. SIMD target-cpu caveat: real AVX-512/AMX kernels need `-C target-cpu=native`/`x86-64-v4`. v1 (autoencoder) superseded per the user's no-float directive. |
637+
| D-ARM-14 | **Splat-codebook oracle + Wikidata skeleton discovery** — wire the certified jc splat codebook into aerial as the `CodebookDistance` oracle, discover OWL/DOLCE+ SPO HHTL classes + basins, drive the `wikidata-hhtl-load.md` deterministic compression (skeleton + basins + CAM-dedup + thin rows). | lance-graph-arm-discovery::aerial + crates/jc + wikidata loader | ~? | MED | **Queued (architecture)** | CONJECTURE pipeline; seams concrete (`CodebookDistance` ← jc `[u32;dim²]` table built by `ewa_sandwich`+`sigma_codebook_probe` ρ=0.9973+`pflug` Lε; Jirak floor ← `jc::jirak`). Float lives OFFLINE in jc only; aerial online path integer. No new aerial dep (pass the frozen table in). Gated on D-ARM-7. Full map: `splat-codebook-aerial-wikidata-compression.md`; finding E-ARM-JC-RESOLVES-BOTH-SEAMS. |
637638
| D-ARM-SYN-1 | Add `Implies`/`CoOccursWith` to `ruff_spo_triplet::Predicate` closed vocabulary (+ `Provenance` tier) so ARM rules load through the same `parse_triples` ndjson path as the static extractor | ruff/ruff_spo_triplet | 40 | MED | **Queued** | council-gated (deliberate ontology change); blocks SYN-2; see `.claude/knowledge/aerial-arm-ruff-spo-codegen-synergies.md` §1 |
638639
| D-ARM-SYN-2 | `CandidateRule → ruff_spo_triplet::ModelGraph` adapter so the Aerial runtime-data leg joins the `ruff_python_dto_check` static-AST leg in one graph before `expand()` | lance-graph-arm-discovery + ruff_spo_triplet | 120 | MED | **Queued** | depends on SYN-1; synergy doc §2 |
639640
| D-ARM-SYN-3 | Calibrate `ProvenanceTier::ArmDiscovered` `(f,c)` below the `op_emitter` ratification gate + below static `Inferred (0.85,0.75)` so un-ratified ARM truth is council-visible but codegen-filtered | lance-graph-contract + lance-graph-ontology::op_emitter | 30 | MED | **Queued** | depends on D-ARM-1 + SYN-1; synergy doc §3/§4 |

0 commit comments

Comments
 (0)