Skip to content

Commit 45d6f80

Browse files
docs(3-pool): correct CI-fn gradient scaling write-up
Match the n_ci fix and correct the imp-min explanation in the distributed walkthrough's §10: the autograd-aware all_reduce backward SUM-reduces the grad (it does not "broadcast unchanged"), and PPGD's CI grad carries an extra n_ci to survive the CI-pool AVG (its V/U grad does not). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent 8bad23b commit 45d6f80

1 file changed

Lines changed: 675 additions & 0 deletions

File tree

0 commit comments

Comments
 (0)