Commit 73ed620
committed
[None][fix] AutoDeploy: set enable_spec_decode on ADEngine for disagg
ADEngine subclasses the abstract ModelEngine and does not run
PyTorchModelEngine.__init__, so it never set `enable_spec_decode`. After
#14546 added an unguarded `self.model_engine.enable_spec_decode` read in
`_prepare_disagg_gen_transmission_complete` (the disagg generation handoff
path that ADEngine traverses via #14057 AutoDeploy Basic Disagg Support),
AutoDeploy disaggregated runs crash with:
AttributeError: 'ADEngine' object has no attribute 'enable_spec_decode'
#14546 and #14057 each passed CI independently but conflict semantically
once both are on main. Set `is_spec_decode`/`enable_spec_decode` in
ADEngine.__init__, mirroring PyTorchModelEngine
(enable_spec_decode == spec_config is not None), so ADEngine satisfies the
ModelEngine attribute contract that shared PyExecutor code relies on.
Signed-off-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>1 parent 835fd61 commit 73ed620
1 file changed
Lines changed: 5 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
494 | 494 | | |
495 | 495 | | |
496 | 496 | | |
| 497 | + | |
| 498 | + | |
| 499 | + | |
| 500 | + | |
| 501 | + | |
497 | 502 | | |
498 | 503 | | |
499 | 504 | | |
| |||
0 commit comments