Spectron optimizer for low-rank LLM pretraining #104

mkhona-nvidia wants to merge 15 commits into

NVIDIA-NeMo:mainNVIDIA-NeMo/Emerging-Optimizers:mainfrom

mkhona-nvidia:mkhona/spectronmkhona-nvidia/Emerging-Optimizers:mkhona/spectronCopy head branch name to clipboard