@@ -672,21 +672,24 @@ backend-inconsistent selection instability) set of dominant channel positions at
672672| Original uncalibrated turbo4_64 | ~ 2.4-2.6 | baseline (34B/block) |
673673| Recalibrated shared table (dead end) | 2.72 (worse) | same |
674674| OL (4 outlier channels) | 1.66 | +18% (40B) |
675+ | ** OL8 (8 outlier channels) — chosen** | ** 0.45** | ** +35% (46B)** |
675676| Q8_0 (added this session, full Vulkan implementation) | 0.61 | +100% (68B) |
676- | ** OL12 (12 outlier channels) — shipped** | ** 0.54** | ** +53% (52B)** |
677-
678- OL12 closes the gap to the same tier as Q8_0 at roughly half the storage overhead — the best option given
679- an 8GB VRAM constraint that rules out Q8_0's footprint. Op-level harness: 38/38 PASS, no regressions to
680- F16/turbo4_0/turbo4_64/Q8_0. Full investigation detail, the complete 6-cell sweep matrix (including the
681- N=64-recalibrated-table combinations, all of which underperformed the original table at every outlier
682- count), and root-cause verification steps are in ` .superpowers/sdd/paged-attn-layer-divergence-report.md ` ,
677+ | OL12 (12 outlier channels) | 0.54 (at full 575-chunk corpus) | +53% (52B) |
678+
679+ User's final call: ** OL8** , not OL12 — 0.45σ (well within noise given the ~ 0.6 stderr at this sample size)
680+ at meaningfully less storage than OL12. Both close the gap to Q8_0's tier or better at a fraction of its
681+ footprint cost. Op-level harness: 38/38 PASS, no regressions to F16/turbo4_0/turbo4_64/Q8_0. Full
682+ investigation detail, the complete 6-cell sweep matrix (including the N=64-recalibrated-table
683+ combinations, all of which underperformed the original table at every outlier count), and root-cause
684+ verification steps are in ` .superpowers/sdd/paged-attn-layer-divergence-report.md ` ,
683685` .superpowers/sdd/turbo4_64_outlier-report.md ` , and ` .superpowers/sdd/outlier-matrix-report.md ` .
684686
685687** Status: RESOLVED.** This was originally filed as out-of-scope for SP2.5 since the op-level harness was
686688already clean; it turned into a full root-cause + fix cycle at the user's insistence, and the fix
687- (` GGML_TYPE_TURBO4_64_OL12 ` , selectable via ` --cache-type-k/v turbo4_64_ol12 ` ) is available for any
688- head_dim-64 hybrid-attention model wanting tight cross-backend parity without Q8_0's footprint cost. The
689- diagnostic tooling (` examples/pagedattn-dump/ ` , ` examples/pagedattn-repro/ ` ) remains uncommitted
689+ (` GGML_TYPE_TURBO4_64_OL8 ` , selectable via ` --cache-type-k/v turbo4_64_ol8 ` ) is the recommended choice for
690+ any head_dim-64 hybrid-attention model wanting tight cross-backend parity without Q8_0's footprint cost
691+ (` turbo4_64_ol12 ` remains available too, for a small additional margin at more storage, if ever needed).
692+ The diagnostic tooling (` examples/pagedattn-dump/ ` , ` examples/pagedattn-repro/ ` ) remains uncommitted
690693(investigative-only, not for merge) — safe to discard or keep for future similar investigations.
691694
692695---
0 commit comments