Skip to content

Commit 0701cb7

Browse files
committed
Add 3DGS PR-X12 cross-pollination capstone
1 parent b5bfcd8 commit 0701cb7

1 file changed

Lines changed: 283 additions & 0 deletions

File tree

Lines changed: 283 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,283 @@
1+
# 3DGS / PR-X12 Cross-Pollination Capstone — lance-graph
2+
3+
## Purpose
4+
5+
Capture the wider expansion discovered by connecting the Cesium / maps / 3DGS exploration with the older PR-X12 codec canon.
6+
7+
The key realization:
8+
9+
```text
10+
Cesium-style 3D tile traversal
11+
PR-X12 Skip/Merge/Delta/Escape block grammar
12+
GGUF/safetensors tensor compression
13+
HHTL datalake traversal
14+
SplatShaderBlas / BLASGraph execution
15+
```
16+
17+
are not separate tracks. They are different faces of the same substrate:
18+
19+
```text
20+
hierarchical local fields
21+
-> approximate block reconstruction
22+
-> certified skip / refine / hydrate / render / decode decisions
23+
```
24+
25+
## Capstone thesis
26+
27+
```text
28+
The maps path proves the traversal.
29+
The codec path proves the block grammar.
30+
The GGUF/safetensors path proves tensor deployment value.
31+
The datalake path proves generality.
32+
```
33+
34+
Together they define a universal execution pattern:
35+
36+
```text
37+
structured source
38+
-> hierarchical block graph
39+
-> compressed/certified local kernels
40+
-> query/render/decode/hydrate schedule
41+
-> exact work only where the certificate demands it
42+
```
43+
44+
## Cross-pollination map
45+
46+
| Source line | Core idea | What it contributes |
47+
|---|---|---|
48+
| Cesium / 3D Tiles | HLOD, tile hierarchy, implicit tiling, screen-space error | traversal grammar |
49+
| ArcGIS | enterprise geospatial service model, FeatureServer/MapServer/Scene layers | data-source compatibility |
50+
| 3DGS | anisotropic kernels, EWA projection, scene anchors | local-field reconstruction |
51+
| PR-X12 x265 | Skip/Merge/Delta/Escape, BLAS/GEMM codec loops | compressed block grammar |
52+
| PR-X12 x266 | EWA splat as `Basis<T>` | basis-swappable reconstruction |
53+
| PR-X12 GGUF | tensor CTUs, activation-aware RDO, decode-during-GEMM | model deployment path |
54+
| PR-X12 anti-neural | frozen lookup tables instead of NN hot loops | deterministic low-latency runtime |
55+
| SplatShaderBlas | tiered bitpacked / palette / 3DGS execution | unified execution naming |
56+
| Datalake HHTL | certified block pruning and hydration | non-visual generalization |
57+
58+
## General substrate shape
59+
60+
```text
61+
Source domain
62+
-> adapter
63+
-> block hierarchy
64+
-> local kernel summary
65+
-> certificate
66+
-> action
67+
```
68+
69+
Actions should stay common:
70+
71+
```text
72+
skip
73+
keep approximate
74+
refine
75+
hydrate metadata
76+
hydrate exact payload
77+
render
78+
decode
79+
fallback
80+
reject
81+
```
82+
83+
## Maps as the first visible body
84+
85+
The maps path starts with:
86+
87+
```text
88+
3D Tiles / Cesium / ArcGIS source
89+
-> tiles / contents / features / splat blocks
90+
-> Lance/Arrow sidecar
91+
-> ndarray 3DGS EWA/SYRK kernels
92+
-> certified tile decision
93+
```
94+
95+
What it enables:
96+
97+
```text
98+
offline or local-first 3D worlds
99+
queryable digital twins
100+
certified tile skipping/refinement
101+
3DGS scene overlays
102+
feature-aware rendering
103+
change detection with error envelopes
104+
```
105+
106+
But the same structure extends beyond maps.
107+
108+
## Datalake as the first non-visual body
109+
110+
The datalake path maps tiles to fragments:
111+
112+
```text
113+
tile -> fragment / row group / page
114+
bounding volume -> stats / bloom / centroid / schema domain
115+
screen-space error -> query relevance / confidence error
116+
refine -> hydrate deeper metadata or exact rows
117+
render -> execute query / scan rows / return vectors
118+
```
119+
120+
What it enables:
121+
122+
```text
123+
metadata-only query planning
124+
certified shard skipping
125+
vector + SQL + graph hybrid traversal
126+
EXPLAIN output with skip/refine reasons
127+
partial hydration of exact rows only when needed
128+
```
129+
130+
## GGUF / safetensors as the tensor body
131+
132+
The tensor-container path maps codec CTUs to model-weight blocks:
133+
134+
```text
135+
video CTU
136+
-> tensor CTU
137+
-> activation-aware RDO
138+
-> basin/codebook pointer
139+
-> residual tail
140+
-> decode-during-GEMM
141+
```
142+
143+
What it enables:
144+
145+
```text
146+
GGUF Q_PRX12 experimental quant type
147+
safetensors sidecar compression
148+
Lance tensor chunk storage
149+
partial model loading
150+
cross-layer / cross-head Merge
151+
model-weight lakehouse search
152+
smaller distribution artifacts
153+
```
154+
155+
## Anti-neural rule
156+
157+
The runtime discipline should be explicit:
158+
159+
```text
160+
NNs may train tables.
161+
NNs do not run in the hot loop.
162+
```
163+
164+
Preferred inner-loop primitives:
165+
166+
```text
167+
lookup table
168+
popcount
169+
palette distance
170+
BLAS / GEMM / SYRK
171+
EWA sandwich
172+
rANS
173+
HHTL traversal
174+
```
175+
176+
This is what keeps the substrate deterministic, explainable, portable, and cheap.
177+
178+
## Unifying graph model
179+
180+
Represent all domains with the same graph skeleton:
181+
182+
```text
183+
Source
184+
-> Frame / Tensor / Dataset / Tileset
185+
-> Block
186+
-> KernelSummary
187+
-> Certificate
188+
-> Decision
189+
-> Output / Payload
190+
```
191+
192+
Examples:
193+
194+
```text
195+
Tileset -> Tile -> SplatBlock -> Certificate -> RenderDecision
196+
Dataset -> Fragment -> RowGroup -> Certificate -> HydrationDecision
197+
GGUF -> Tensor -> TensorBlock -> Certificate -> DecodeDecision
198+
Safetensors -> TensorShard -> TensorBlock -> Certificate -> LanceChunk
199+
Ultrasound -> Frame -> PSFBlock -> Certificate -> FusionDecision
200+
```
201+
202+
## What this enables by domain
203+
204+
```text
205+
geospatial:
206+
certified 3D maps, digital twins, ArcGIS/Cesium interop
207+
208+
datalake:
209+
HHTL query planning, explainable skipping, vector/SQL/graph fusion
210+
211+
LLM deployment:
212+
GGUF/safetensors compression, decode-during-GEMM, partial loading
213+
214+
RAG:
215+
chunk-family traversal with provenance and retrieval confidence
216+
217+
observability:
218+
incident-root traversal over logs/traces/metrics/deploy events
219+
220+
robotics:
221+
sensor-field updates with map-change certificates
222+
223+
ultrasound:
224+
RF/IQ/Doppler frame fusion into certified splat volumes
225+
226+
genetics:
227+
motif/gene/pathway block traversal with uncertainty envelopes
228+
229+
neuronal/cognitive fields:
230+
activation/edge/time block comparison with 4x4 carrier summaries
231+
```
232+
233+
## Implementation priority
234+
235+
Do not implement every domain. Stabilize the substrate through two hard bodies:
236+
237+
```text
238+
1. 3DGS geospatial tile runtime
239+
2. HHTL datalake traversal
240+
```
241+
242+
Then attach tensor-container work:
243+
244+
```text
245+
3. PR-X12 GGUF/safetensors tensor block prototype
246+
4. Lance/Arrow tensor chunk storage
247+
5. decode-during-GEMM microbench
248+
```
249+
250+
Exploratory domains remain adapters until the core proves itself.
251+
252+
## Required references across plan set
253+
254+
This capstone should be kept linked with:
255+
256+
```text
257+
3DGS-Cesium-feature-mapping-plan.md
258+
3DGS-HHTL-datalake-traversal-plan.md
259+
3DGS-SplatShaderBlas-BLASGraph-crosspollination-plan.md
260+
3DGS-blast-radius-application-map.md
261+
3DGS-domain-adapter-strategy-plan.md
262+
3DGS-certified-query-render-plan.md
263+
```
264+
265+
The ndarray sibling capstone is:
266+
267+
```text
268+
PR-X12-tensor-container-expansion-capstone.md
269+
```
270+
271+
## Acceptance criteria
272+
273+
- The plan set no longer frames 3DGS as only geospatial.
274+
- PR-X12, GGUF/safetensors, and datalake traversal are explicitly connected.
275+
- SplatShaderBlas / BLASGraph is treated as the execution bridge.
276+
- Domain adapters remain separate from the core substrate.
277+
- The first implementation path remains small and testable.
278+
279+
## Wall sentence
280+
281+
```text
282+
Cesium gave us the world-tree, PR-X12 gave us the block grammar, GGUF/safetensors give us tensor deployment, and HHTL turns all of it into certified traversal.
283+
```

0 commit comments

Comments
 (0)