Commit 45d6f80
docs(3-pool): correct CI-fn gradient scaling write-up
Match the n_ci fix and correct the imp-min explanation in the distributed
walkthrough's §10: the autograd-aware all_reduce backward SUM-reduces the grad
(it does not "broadcast unchanged"), and PPGD's CI grad carries an extra n_ci to
survive the CI-pool AVG (its V/U grad does not).
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>1 parent 8bad23b commit 45d6f80
1 file changed
Lines changed: 675 additions & 0 deletions
0 commit comments