zero3: SDMA allgather via mori (sdma_allgather) #7999

Open

inkcherry wants to merge 21 commits intodeepspeedai:masterfrom

inkcherry:sdma_ag_

Commits on May 8, 2026

add zero3 example
wuyl1
committed
enable sdma allgather
wuyl1
committed
fix bug
wuyl1
committed
fix bug
wuyl1
committed
fix bug
wuyl1
committed
add test case
wuyl1
committed
fix bug
wuyl1
committed
copy_output_to_user=True
wuyl1
committed
use same training sample
wuyl1
committed
add flops
wuyl1
committed
add training log
wuyl1
committed
change to 2.7b
wuyl1
committed
copy_output_to_user: bool = False
wuyl1
committed
fix noncopy
wuyl1
committed
fix bug
wuyl1
committed
update
wuyl1
committed
use real txt
wuyl1
committed
zero3: route SDMA allgather through mori_cpp.AllGatherIntoTensor
inkcherry
committed
zero3: drop CPU sync from SDMA Work.wait() to match RCCL semantics
inkcherry
committed
zero3: add sdma_allgather end-to-end examples (GPT + Qwen3-32B)
inkcherry
committed
update readme
inkcherry
committed