Commit fc75c6f
feat(export): thread optimize through compile_to_onnx to forward_compile
compile_to_onnx hardwired the heuristic scheduler (optimize=0); expose the param
so callers can opt into CP-SAT, matching forward_compile. optimize=0 default keeps
existing behavior. Pure pass-through; the shared layer loop streams under both
schedulers (validated: compile_to_onnx optimize=2 completes at ~4.2GB).
Note: on the DOOM token-I/O forward, CP-SAT was a no-op for depth (66=66 @ fanout=2,
44=44 @ fanout=8 vs the heuristic) at 3.5-4.5x compile time — the heuristic is already
optimal-depth; the depth lever is graph-side (dispatch max_fanout). So this is API
completeness, not a doom win.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>1 parent 2b32624 commit fc75c6f
1 file changed
Lines changed: 2 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
758 | 758 | | |
759 | 759 | | |
760 | 760 | | |
| 761 | + | |
761 | 762 | | |
762 | 763 | | |
763 | 764 | | |
| |||
799 | 800 | | |
800 | 801 | | |
801 | 802 | | |
| 803 | + | |
802 | 804 | | |
803 | 805 | | |
804 | 806 | | |
| |||
0 commit comments