Commit f96fa0c
committed
docs(synergies): §7.5 immaterialized cascade as storage — Morton-keyed columnar grid-pyramid
Operator synthesis (2026-06-08): the Morton cascade is a coordinate
transform, not a stored grid — like (lat,lon) -> quadkey is a cheap
closed-form bit-interleave with no materialized grid. The cascade
computes cell membership on demand; it is never built. That makes it a
reusable addressing layer any payload can hang off.
New §7.5 captures the storage-layer consequence:
- Address vs payload (ADR-023) at storage scale: ADDRESS = Morton
prefix (immaterialized, arithmetic, amortizes to ~0 — §7 best
case); PAYLOAD = columnar (Lance / Parquet-family / PR #477 SoA),
rows in Morton order.
- The columnar-pushdown identity [G — deployed lakehouse tech]:
Z-order/Hilbert row clustering for data-skipping is production
tech (Delta ZORDER, Iceberg/Hudi clustering, BigQuery clustering).
row=cell, row-group=tile, prefix-pushdown=tile-fetch,
column-chunk=SoA role/level column, page=leaf nibble. The format's
own machinery IS the cascade's storage + tile-fetch, free.
- Honest sharpening: classic Parquet row-groups are scan-optimized;
the cascade wants random tile access (any prefix, any version) =
Lance's advantage. "parquet-shaped" = the columnar family; Lance is
the substrate's actual instance.
- Four payloads on one immaterialized address: delta frames (version-
diff = changed Morton cells = codec P-frame; I-frame=materialized
version, B-frame doesn't map onto append-only log — honest limit)
[H]; radix trie (VART lazy paths) [G]; HHTL/OGIT/helix (one address
three roles) [G]; CAM-PQ (semantic columns) [G].
- The unifying shape "parquet-shaped grid-pyramid shader": columnar
storage (parquet) + Morton-ordered rows (grid) + level cascade
(pyramid) + closed-form per-cell (shader). Every layer production-
proven, just composed.
- Honest limit: the immaterialization isn't total — address is
immaterialized (arithmetic), payload is materialized (columns). The
grid is free; the data is the SoA-headroom spend (§7).
Cross-refs (§11) gain the deployed Z-order/lakehouse anchor + the
Lance-vs-Parquet random-access note.
Docs-only; epiphany-capture status unchanged. PII abort-guard
(word-boundary): CLEAN. cargo check: clean.
https://claude.ai/code/session_01PBTGaPCSnnt6u3pjXpbLwY1 parent 25f3d09 commit f96fa0c
1 file changed
Lines changed: 83 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
285 | 285 | | |
286 | 286 | | |
287 | 287 | | |
| 288 | + | |
| 289 | + | |
| 290 | + | |
| 291 | + | |
| 292 | + | |
| 293 | + | |
| 294 | + | |
| 295 | + | |
| 296 | + | |
| 297 | + | |
| 298 | + | |
| 299 | + | |
| 300 | + | |
| 301 | + | |
| 302 | + | |
| 303 | + | |
| 304 | + | |
| 305 | + | |
| 306 | + | |
| 307 | + | |
| 308 | + | |
| 309 | + | |
| 310 | + | |
| 311 | + | |
| 312 | + | |
| 313 | + | |
| 314 | + | |
| 315 | + | |
| 316 | + | |
| 317 | + | |
| 318 | + | |
| 319 | + | |
| 320 | + | |
| 321 | + | |
| 322 | + | |
| 323 | + | |
| 324 | + | |
| 325 | + | |
| 326 | + | |
| 327 | + | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
| 331 | + | |
| 332 | + | |
| 333 | + | |
| 334 | + | |
| 335 | + | |
| 336 | + | |
| 337 | + | |
| 338 | + | |
| 339 | + | |
| 340 | + | |
| 341 | + | |
| 342 | + | |
| 343 | + | |
| 344 | + | |
| 345 | + | |
| 346 | + | |
| 347 | + | |
| 348 | + | |
| 349 | + | |
| 350 | + | |
| 351 | + | |
| 352 | + | |
| 353 | + | |
| 354 | + | |
| 355 | + | |
| 356 | + | |
| 357 | + | |
| 358 | + | |
| 359 | + | |
| 360 | + | |
| 361 | + | |
| 362 | + | |
| 363 | + | |
| 364 | + | |
288 | 365 | | |
289 | 366 | | |
290 | 367 | | |
| |||
360 | 437 | | |
361 | 438 | | |
362 | 439 | | |
| 440 | + | |
| 441 | + | |
| 442 | + | |
| 443 | + | |
| 444 | + | |
| 445 | + | |
363 | 446 | | |
364 | 447 | | |
365 | 448 | | |
| |||
0 commit comments