Skip to content

[model] Add Megatron-Bridge support for MiniMax M3 #4585

Description

@cuichenx

Summary

Track Megatron-Bridge support for MiniMax M3 — the successor to MiniMax-M1 / MiniMax-M2 (#1475, closed).

Scope

  • Model provider: configure Megatron Core with MiniMax M3 architecture (likely hybrid attention / lightning attention pattern carried over from M1/M2)
  • Bridge implementation: bidirectional HuggingFace ↔ Megatron weight mapping (@register_bridge)
  • Recipe: pretraining / SFT recipe under src/megatron/bridge/recipes/minimax/
  • AutoBridge registration matrix coverage
  • Unit tests under tests/unit_tests/models/minimax/
  • Functional / convergence test with a public M3 checkpoint
  • Docs page under docs/ following the model-family taxonomy

Context

Open questions

  • HuggingFace repo / config availability for M3 (waiting on public release)
  • Architectural deltas vs M2 (attention pattern, MoE topology, RoPE variant)
  • Target hardware (H100 / GB200 / B200/300) and parallelism plan

References

  • Bridge release tracker: MB-585 (26.08 PoR)

Metadata

Metadata

Assignees

No one assigned

    Labels

    PoRPlan of record item for roadmap and release trackingarea:modelModel implementations and HF bridge logicfeatureNew capabilities, enhancements, or enablement worktrackingTracking issue for an ongoing project with smaller steps

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions