[bugfix] Fix abnormal grad_norm under GRPO LoRA + DeepSpeed ZeRO-0 (fix #6815)#8341

Open

alphadl wants to merge 1 commit intomodelscope:mainfrom

alphadl:fix/6815-grad-norm-zero0-reduce

Commits on Mar 14, 2026

[bugfix] fix abnormal grad_norm under ZeRO-0/DDP by all-reduce (fix #6815) - Add _get_reduced_grad_norm_for_logging to reduce grad_norm across processes when not ZeRO-3 and world_size > 1 (AVG) - U…
alphadl
committed