Support NemotronH hybrid Mamba+Attention+MoE training (e.g. Nemotron Nano-30B-A3B)#2211
Open
HelloWorldLTY wants to merge 1 commit into
Open
Support NemotronH hybrid Mamba+Attention+MoE training (e.g. Nemotron Nano-30B-A3B)#2211HelloWorldLTY wants to merge 1 commit into
HelloWorldLTY wants to merge 1 commit into
