Commit 49baa0c
committed
feat(v5-g07): extras.{train_dtype, master_dtype, fp8_active} from spec
Closes V5-G07 / cppmega-mlx-wz2. spec.optim.mixed_precision +
spec.sharding.fp8_enabled were decorative — stage_train always used
bf16 defaults. v5 reads them and reports in extras (propagation only —
real dtype switching needs deeper mlx plumbing, deferred to v6).
- master_dtype = 'fp32' if mixed_precision else 'bf16'
- train_dtype = 'fp8' if fp8_enabled else 'bf16'
- fp8_active = bool(spec.sharding.fp8_enabled)
1/1 e2e + 43 stage_train pytest green.1 parent f523359 commit 49baa0c
2 files changed
Lines changed: 53 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
634 | 634 | | |
635 | 635 | | |
636 | 636 | | |
| 637 | + | |
| 638 | + | |
| 639 | + | |
| 640 | + | |
| 641 | + | |
| 642 | + | |
| 643 | + | |
| 644 | + | |
| 645 | + | |
| 646 | + | |
| 647 | + | |
| 648 | + | |
| 649 | + | |
| 650 | + | |
| 651 | + | |
| 652 | + | |
| 653 | + | |
| 654 | + | |
| 655 | + | |
| 656 | + | |
637 | 657 | | |
638 | 658 | | |
639 | 659 | | |
| |||
791 | 811 | | |
792 | 812 | | |
793 | 813 | | |
| 814 | + | |
| 815 | + | |
| 816 | + | |
794 | 817 | | |
795 | 818 | | |
796 | 819 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
0 commit comments