Commit d4344df
feat(wp): tag routed-expert tensors with is_expert at load
Phase 1 Task 1 of the MoE resident/paged split. Add is_expert to
llama_weight_page_info, set from the existing is_consolidated detection
(ffn_*_exps name match) at load. Lets a later filter page only expert
tensors and leave dense weights resident. No behavior change yet.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014ZRfPpL8XFzk1hep9MMg9P1 parent 5a87918 commit d4344df
2 files changed
Lines changed: 5 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
41 | 41 | | |
42 | 42 | | |
43 | 43 | | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
44 | 48 | | |
45 | 49 | | |
46 | 50 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1795 | 1795 | | |
1796 | 1796 | | |
1797 | 1797 | | |
| 1798 | + | |
1798 | 1799 | | |
1799 | 1800 | | |
1800 | 1801 | | |
| |||
0 commit comments