Skip to content

Commit 7f7fc7d

Browse files
committed
docs(sp2.5): recommend turbo4_64_ol8 over ol12 as the chosen fix
User's call after reviewing the full sweep: OL8 (0.45 sigma, +35% storage) is well within noise at this sample size and costs meaningfully less than OL12 (0.54 sigma at full corpus, +53% storage), while still closing the gap to Q8_0's tier. OL12 remains available as a selectable type for a small additional margin if ever needed; no code changes required since both were already implemented and tested as part of the sweep.
1 parent b683f0c commit 7f7fc7d

1 file changed

Lines changed: 13 additions & 10 deletions

File tree

docs/superpowers/plans/2026-06-30-sp2-multibracket-paged-turbo-vulkan.md

Lines changed: 13 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -672,21 +672,24 @@ backend-inconsistent selection instability) set of dominant channel positions at
672672
| Original uncalibrated turbo4_64 | ~2.4-2.6 | baseline (34B/block) |
673673
| Recalibrated shared table (dead end) | 2.72 (worse) | same |
674674
| OL (4 outlier channels) | 1.66 | +18% (40B) |
675+
| **OL8 (8 outlier channels) — chosen** | **0.45** | **+35% (46B)** |
675676
| Q8_0 (added this session, full Vulkan implementation) | 0.61 | +100% (68B) |
676-
| **OL12 (12 outlier channels) — shipped** | **0.54** | **+53% (52B)** |
677-
678-
OL12 closes the gap to the same tier as Q8_0 at roughly half the storage overhead — the best option given
679-
an 8GB VRAM constraint that rules out Q8_0's footprint. Op-level harness: 38/38 PASS, no regressions to
680-
F16/turbo4_0/turbo4_64/Q8_0. Full investigation detail, the complete 6-cell sweep matrix (including the
681-
N=64-recalibrated-table combinations, all of which underperformed the original table at every outlier
682-
count), and root-cause verification steps are in `.superpowers/sdd/paged-attn-layer-divergence-report.md`,
677+
| OL12 (12 outlier channels) | 0.54 (at full 575-chunk corpus) | +53% (52B) |
678+
679+
User's final call: **OL8**, not OL12 — 0.45σ (well within noise given the ~0.6 stderr at this sample size)
680+
at meaningfully less storage than OL12. Both close the gap to Q8_0's tier or better at a fraction of its
681+
footprint cost. Op-level harness: 38/38 PASS, no regressions to F16/turbo4_0/turbo4_64/Q8_0. Full
682+
investigation detail, the complete 6-cell sweep matrix (including the N=64-recalibrated-table
683+
combinations, all of which underperformed the original table at every outlier count), and root-cause
684+
verification steps are in `.superpowers/sdd/paged-attn-layer-divergence-report.md`,
683685
`.superpowers/sdd/turbo4_64_outlier-report.md`, and `.superpowers/sdd/outlier-matrix-report.md`.
684686

685687
**Status: RESOLVED.** This was originally filed as out-of-scope for SP2.5 since the op-level harness was
686688
already clean; it turned into a full root-cause + fix cycle at the user's insistence, and the fix
687-
(`GGML_TYPE_TURBO4_64_OL12`, selectable via `--cache-type-k/v turbo4_64_ol12`) is available for any
688-
head_dim-64 hybrid-attention model wanting tight cross-backend parity without Q8_0's footprint cost. The
689-
diagnostic tooling (`examples/pagedattn-dump/`, `examples/pagedattn-repro/`) remains uncommitted
689+
(`GGML_TYPE_TURBO4_64_OL8`, selectable via `--cache-type-k/v turbo4_64_ol8`) is the recommended choice for
690+
any head_dim-64 hybrid-attention model wanting tight cross-backend parity without Q8_0's footprint cost
691+
(`turbo4_64_ol12` remains available too, for a small additional margin at more storage, if ever needed).
692+
The diagnostic tooling (`examples/pagedattn-dump/`, `examples/pagedattn-repro/`) remains uncommitted
690693
(investigative-only, not for merge) — safe to discard or keep for future similar investigations.
691694

692695
---

0 commit comments

Comments
 (0)