Skip to content

Adding "spectral clipped" weight decay to be used together with matrix-based preconditioning optimizers#34

Closed
mkhona-nvidia wants to merge 19 commits into
NVIDIA-NeMo:mainfrom
mkhona-nvidia:mkhona/spectral_clipping_weight_decay
Closed

Adding "spectral clipped" weight decay to be used together with matrix-based preconditioning optimizers#34
mkhona-nvidia wants to merge 19 commits into
NVIDIA-NeMo:mainfrom
mkhona-nvidia:mkhona/spectral_clipping_weight_decay

Commits

Commits on Oct 3, 2025