LAprop as an optimizer along with frobenius weight normalization + associated tests#206

skyw merged 8 commits into

NVIDIA-NeMo:mainNVIDIA-NeMo/Emerging-Optimizers:mainfrom

mkhona-nvidia:mkhona/lapropmkhona-nvidia/Emerging-Optimizers:mkhona/lapropCopy head branch name to clipboard