Skip to content

Commit 042ef45

Browse files
kmbandyclaude
andcommitted
docs(wp): Phase 1 best config — P2P depth-4 = 1.038 t/s (52x), into 1-3 target
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014ZRfPpL8XFzk1hep9MMg9P
1 parent 8e09fcf commit 042ef45

1 file changed

Lines changed: 11 additions & 0 deletions

File tree

docs/dev/weight-paging-batch-eval-continuation.md

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -500,3 +500,14 @@ lever to raise QD past 4 → past 0.93 t/s toward 1-3.
500500
**NOT YET TESTED:** P2P transport + resident-dense at depth 4 (may beat host's
501501
1.4 GB/s via direct-to-VRAM). Phase 2 (multi-device TB3) + Phase 3 (expert cache)
502502
still ahead.
503+
504+
**DEPTH-4 SWEEP (best stable config found):**
505+
- host, slots 2000: 0.93 t/s
506+
- host, slots 3000: 0.65 t/s (more slots did NOT help — 0% prefetch hit, low cross-token expert locality)
507+
- **P2P, slots 2000: 1.038 t/s** ← BEST, coherent, ~52× over 0.02 baseline, INTO the 1-3 t/s target.
508+
(io_effective "186 GB/s" is the batched-timing artifact for direct-to-VRAM; not literal.)
509+
510+
**Bottleneck now:** page_ins ~11k, evictions ~9k, prefetch_hit_rate 0% — the expert cache barely
511+
hits (routing locality low at this cache size). Levers to go higher: (1) fix the depth>4 hang → QD>4;
512+
(2) Phase 2 (dense on 6900XT eGPU frees full 32GB R9700 for expert cache); (3) Phase 3 frequency-biased
513+
retention + prefetch coverage. Slot-count alone is a weak lever. Phase 1 gate: PASSED (coherent, >>0.4).

0 commit comments

Comments
 (0)