Skip to content

[Qwen2MoE] Fix h1_normed gradient accumulation order divergence via probe hook#4407

Open
a31413510 wants to merge 1 commit into
fix/qwen2_moe-gradient-alignmentfrom
fix/qwen2_moe-h1-normed-grad-sync
Open

[Qwen2MoE] Fix h1_normed gradient accumulation order divergence via probe hook#4407
a31413510 wants to merge 1 commit into
fix/qwen2_moe-gradient-alignmentfrom
fix/qwen2_moe-h1-normed-grad-sync

[Qwen2MoE] Fix h1_normed gradient accumulation order divergence

6e6fd65
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar