Commit eb9f660
committed
chore: bump Megatron-LM submodule to mcore main b4ad280d
Bump 3rdparty/Megatron-LM to the tip of Megatron-LM main and record it in
.main.commit. uv.lock refresh follows in a separate commit.
Signed-off-by: svcnemo-autobot <svcnemo-autobot@nvidia.com>1 parent d7c47a3 commit eb9f660
2 files changed
Lines changed: 2 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
Submodule Megatron-LM updated 18 files
- experimental/agent_compose/README.md+45
- megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/dbuffer.py+22-19
- megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/parameter_group.py+7
- megatron/core/optimizer/__init__.py+18-4
- megatron/core/optimizer/distrib_optimizer.py+56-34
- megatron/core/optimizer/optimizer.py+78-20
- megatron/core/recompute.py+22-4
- megatron/training/training.py+7-1
- pretrain_gpt.py+7
- pretrain_hybrid.py+7
- tests/unit_tests/dist_checkpointing/test_optimizer.py+95-1
- tests/unit_tests/dist_checkpointing/utils.py+10-2
- tests/unit_tests/distributed/mfsdp_v2/test_dbuffer.py+23
- tests/unit_tests/distributed/mfsdp_v2/test_fully_shard.py+34-13
- tests/unit_tests/distributed/mfsdp_v2/test_symmetric_memory.py+84-2
- tests/unit_tests/optimizer/test_param_group_identifier_keys.py+271
- tests/unit_tests/test_lion_optimizer.py+51
- tests/unit_tests/transformer/test_transformer_block.py+100-3
0 commit comments