Skip to content

Commit 2e861d4

Browse files
HuiyingLiclaude
andcommitted
test(nemotron-omni-cp): switch ep8cp2 backend to TE linear + deepep dispatcher
Align the CP-enabled yaml with the non-CP cordv2 baseline: - linear: torch -> te - enable_deepep: false -> dispatcher: deepep (matches cord_v2.yaml) Now ep8cp2 differs from non-CP cordv2 only in: - attn: sdpa -> te (TE-CP path is the supported one) - cp_size: 1 -> 2 (the actual CP-under-test) Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> Signed-off-by: HuiyingLi <willwin.lee@gmail.com>
1 parent e81d1f0 commit 2e861d4

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

examples/vlm_finetune/nemotron_omni/nemotron_omni_v3_cord_v2_ep8cp2.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -30,10 +30,10 @@ model:
3030
backend:
3131
_target_: nemo_automodel.components.models.common.BackendConfig
3232
attn: te
33-
linear: torch
33+
linear: te
3434
rms_norm: torch_fp32
3535
rope_fusion: false
36-
enable_deepep: false
36+
dispatcher: deepep
3737
fake_balanced_gate: false
3838
enable_hf_state_dict_adapter: true
3939

0 commit comments

Comments
 (0)