Skip to content

chore(deps): AUT-901 bump Megatron-LM to mcore main b4ad280d #4948

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
svcnemo-autobot merged 4 commits into from
Jul 19, 2026
+94 −76
Merged

chore(deps): AUT-901 bump Megatron-LM to mcore main b4ad280d #4948

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
05a66ed
chore: bump Megatron-LM submodule to mcore main b4ad280d
svcnemo-autobot Jul 18, 2026
826c131
chore: regenerate uv.lock for mcore main bump
svcnemo-autobot Jul 19, 2026
7cef4ad
test(doc-consistency): scan perf_recipes for README recipe refs
svcnemo-autobot Jul 19, 2026
ad2ddec
test: add missing copyright header to test_glm_45v_slurm
svcnemo-autobot Jul 19, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .main.commit
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
61f31145dfb4cfaa7d285df12aa9abffb22ff485
b4ad280d352e7d3d57040f60a16f358da1a75893
2 changes: 1 addition & 1 deletion 3rdparty/Megatron-LM
Open in desktop
Submodule Megatron-LM updated 18 files
+45 −0 experimental/agent_compose/README.md
+22 −19 megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/dbuffer.py
+7 −0 megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/parameter_group.py
+18 −4 megatron/core/optimizer/__init__.py
+56 −34 megatron/core/optimizer/distrib_optimizer.py
+78 −20 megatron/core/optimizer/optimizer.py
+22 −4 megatron/core/recompute.py
+7 −1 megatron/training/training.py
+7 −0 pretrain_gpt.py
+7 −0 pretrain_hybrid.py
+95 −1 tests/unit_tests/dist_checkpointing/test_optimizer.py
+10 −2 tests/unit_tests/dist_checkpointing/utils.py
+23 −0 tests/unit_tests/distributed/mfsdp_v2/test_dbuffer.py
+34 −13 tests/unit_tests/distributed/mfsdp_v2/test_fully_shard.py
+84 −2 tests/unit_tests/distributed/mfsdp_v2/test_symmetric_memory.py
+271 −0 tests/unit_tests/optimizer/test_param_group_identifier_keys.py
+51 −0 tests/unit_tests/test_lion_optimizer.py
+100 −3 tests/unit_tests/transformer/test_transformer_block.py
8 changes: 6 additions & 2 deletions tests/unit_tests/doc_consistency/test_readme_consistency.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@

REPO_ROOT = Path(__file__).resolve().parents[3]
RECIPES_DIR = REPO_ROOT / "src" / "megatron" / "bridge" / "recipes"
PERF_RECIPES_DIR = REPO_ROOT / "src" / "megatron" / "bridge" / "perf_recipes"
TRAINING_README = REPO_ROOT / "scripts" / "training" / "README.md"
DATASET_UTILS = REPO_ROOT / "src" / "megatron" / "bridge" / "recipes" / "utils" / "dataset_utils.py"
LLAMA_README = REPO_ROOT / "tutorials" / "recipes" / "llama" / "README.md"
Expand Down Expand Up @@ -81,9 +82,12 @@ def _read(p: Path) -> str:


def _defined_recipe_names() -> set[str]:
"""All recipe-config functions and public aliases under src/.../recipes/**."""
"""All recipe-config functions and public aliases under src/.../recipes/** and perf_recipes/**."""
names: set[str] = set()
for py in RECIPES_DIR.rglob("*.py"):
recipe_files = list(RECIPES_DIR.rglob("*.py"))
if PERF_RECIPES_DIR.is_dir():
recipe_files += list(PERF_RECIPES_DIR.rglob("*.py"))
for py in recipe_files:
tree = ast.parse(_read(py), filename=str(py))
for node in tree.body:
if isinstance(node, (ast.FunctionDef, ast.AsyncFunctionDef)) and node.name.endswith("_config"):
Expand Down
14 changes: 14 additions & 0 deletions tests/unit_tests/examples/test_glm_45v_slurm.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,17 @@
# Copyright (c) 2026, NVIDIA CORPORATION. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

import os
import subprocess
from pathlib import Path
Expand Down
Loading
Loading