Skip to content

sequence parallel with communication overlap#5691

Merged
loadams merged 20 commits into
deepspeedai:masterfrom
inkcherry:sp_overlap_comm
Aug 1, 2024
Merged

sequence parallel with communication overlap#5691
loadams merged 20 commits into
deepspeedai:masterfrom
inkcherry:sp_overlap_comm

Commits

Commits on May 21, 2024

Commits on Jun 18, 2024

Commits on Jun 20, 2024

Commits on Jun 21, 2024

Commits on Jul 5, 2024

Commits on Jul 8, 2024

Commits on Jul 10, 2024

Commits on Jul 12, 2024