Commit c070819
committed
fix: update ray executor import for vLLM 0.20
vLLM 0.20 renamed the executor module from ray_distributed_executor to
ray_executor; the class name RayDistributedExecutor and its
collective_rpc method are unchanged. Without this fix, any FP8
generation path that goes through monkey_patch_vllm_ray_executor() with
TP*PP > 1 (i.e. any multi-GPU vllm_cfg.precision='fp8' run) fails at
worker init with:
ModuleNotFoundError: No module named 'vllm.v1.executor.ray_distributed_executor'
Signed-off-by: Aurelien Chartier <2567591+achartier@users.noreply.github.com>1 parent 7f85849 commit c070819
1 file changed
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
82 | 82 | | |
83 | 83 | | |
84 | 84 | | |
85 | | - | |
| 85 | + | |
86 | 86 | | |
87 | 87 | | |
88 | 88 | | |
| |||
0 commit comments