Skip to content

Commit 57203d2

Browse files
committed
example(eagle3): disable torch.compile for Qwen3-0.6B CI train
The recipe compiles the eagle forward with torch.compile(mode="max-autotune") (hf_eagle.py), whose exhaustive Triton bmm autotuning logs benign 'out of resource: triton_bmm' errors on the L40 (it recovers and picks a working config, task SUCCEEDs) and adds compile overhead. Disable it via eagle.eagle_use_torch_compile=false for the CI smoke runs — clean logs, faster. Coverage note: this stops exercising the compiled path; revisit once the recipe lets the compile mode be tuned down instead of forced to max-autotune. Signed-off-by: Chenhan Yu <chenhany@nvidia.com> (cherry picked from commit d4b28a1)
1 parent 5895b60 commit 57203d2

2 files changed

Lines changed: 8 additions & 0 deletions

File tree

tools/launcher/examples/Qwen/Qwen3-0.6B/hf_offline_eagle3.yaml

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -75,6 +75,10 @@ pipeline:
7575
- training.training_seq_len=1024
7676
- training.disable_tqdm=true
7777
- training.ar_validate_steps=500000
78+
# CI: disable torch.compile (recipe default mode="max-autotune") — its
79+
# exhaustive Triton bmm autotuning floods the log with benign "out of
80+
# resource" errors on the L40 and adds compile overhead for no CI benefit.
81+
- eagle.eagle_use_torch_compile=false
7882
slurm_config:
7983
_factory_: "slurm_factory"
8084
nodes: 1

tools/launcher/examples/Qwen/Qwen3-0.6B/hf_online_eagle3.yaml

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -44,6 +44,10 @@ pipeline:
4444
- training.disable_tqdm=true
4545
- training.ar_validate_steps=500000
4646
- training.num_train_epochs=1
47+
# CI: disable torch.compile (recipe default mode="max-autotune") — its
48+
# exhaustive Triton bmm autotuning floods the log with benign "out of
49+
# resource" errors on the L40 and adds compile overhead for no CI benefit.
50+
- eagle.eagle_use_torch_compile=false
4751
slurm_config:
4852
_factory_: "slurm_factory"
4953
nodes: 1

0 commit comments

Comments
 (0)