Skip to content

[megatron] Fix TE sliding-window attention crash at micro_batch>1 on the non-packed forward path#1848

Merged
erictang000 merged 2 commits into
NovaSky-AI:mainfrom
john-hahn:john/megatron-te-swa-mask
Jul 2, 2026
Merged

[megatron] Fix TE sliding-window attention crash at micro_batch>1 on the non-packed forward path#1848
erictang000 merged 2 commits into
NovaSky-AI:mainfrom
john-hahn:john/megatron-te-swa-mask

Commits

Commits on Jun 29, 2026

Commits on Jul 2, 2026