Skip to content

[bugfix] Fix abnormal grad_norm under GRPO LoRA + DeepSpeed ZeRO-0 (fix #6815)#8341

Open
alphadl wants to merge 1 commit into
modelscope:mainfrom
alphadl:fix/6815-grad-norm-zero0-reduce
Open

[bugfix] Fix abnormal grad_norm under GRPO LoRA + DeepSpeed ZeRO-0 (fix #6815)#8341
alphadl wants to merge 1 commit into
modelscope:mainfrom
alphadl:fix/6815-grad-norm-zero0-reduce

[bugfix] fix abnormal grad_norm under ZeRO-0/DDP by all-reduce (fix #…

882cff4
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs