Skip to content

Commit 16846a8

Browse files
authored
feat(model): add model support verification cards (#4909)
Signed-off-by: yaoyu-33 <yaoyu.094@gmail.com>
1 parent d7a1999 commit 16846a8

78 files changed

Lines changed: 7505 additions & 536 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

docs/fern/versions/0.4.2/pages/models/vlm/nemotron-nano-v2-vl.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ We use the following environment variables throughout this page
2424

2525
Unless explicitly stated, any megatron model path in the commands below should NOT contain the iteration number
2626
`iter_xxxxxx`. For more details on checkpointing, please see
27-
[here](../../training/checkpointing.md#checkpoint-contents)
27+
[here](../../training/checkpointing.md#checkpoint-contents)
2828

2929
</Tip>
3030

docs/fern/versions/0.4.2/pages/models/vlm/qwen2.5-vl.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ We use the following environment variables throughout this page
1212

1313
Unless explicitly stated, any megatron model path in the commands below should NOT contain the iteration number
1414
`iter_xxxxxx`. For more details on checkpointing, please see
15-
[here](../../training/checkpointing.md#checkpoint-contents)
15+
[here](../../training/checkpointing.md#checkpoint-contents)
1616

1717
</Tip>
1818

docs/fern/versions/0.4.2/pages/models/vlm/qwen3-vl.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ We use the following environment variables throughout this page
1010
- `MEGATRON_MODEL_PATH=/models/Qwen3-VL-8B-Instruct` (feel free to set your own path)
1111
Unless explicitly stated, any megatron model path in the commands below should NOT contain the iteration number
1212
`iter_xxxxxx`. For more details on checkpointing, please see
13-
[here](../../training/checkpointing.md#checkpoint-contents)
13+
[here](../../training/checkpointing.md#checkpoint-contents)
1414

1515
</Tip>
1616

docs/fern/versions/nightly/pages/models/qwen/qwen.mdx

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -218,9 +218,9 @@ uv run python examples/conversion/hf_to_megatron_generate_text.py \
218218

219219
| Model | Mode | TP | PP | EP | Total GPUs | Use Case |
220220
|-------|------|----|----|----|-----------:|----------|
221-
| **Qwen3-30B-A3B** | Pretrain | 1 | 1 | 8 | 8 | Pre-training (single node) |
222-
| **Qwen3-30B-A3B** | Full SFT | 1 | 1 | 8 | 8 | Full supervised finetuning |
223-
| **Qwen3-30B-A3B** | LoRA/DoRA | 1 | 1 | 8 | 8 | PEFT finetuning (single node) |
221+
| **Qwen3-30B-A3B** | Pretrain | 1 | 1 | 16 | 16 | Pre-training (2 nodes) |
222+
| **Qwen3-30B-A3B** | Full SFT | 1 | 1 | 16 | 16 | Full supervised finetuning (2 nodes) |
223+
| **Qwen3-30B-A3B** | LoRA/DoRA | 4 | 1 | 4 | 4 | PEFT finetuning |
224224
| **Qwen3-235B-A22B** | Pretrain | 2 | 8 | 32 | 512 | Pre-training (64 nodes) |
225225
| **Qwen3-235B-A22B** | Full SFT | 2 | 8 | 32 | 512 | Full supervised finetuning (64 nodes) |
226226
| **Qwen3-235B-A22B** | LoRA/DoRA | 2 | 8 | 32 | 512 | PEFT finetuning (64 nodes) |
@@ -239,7 +239,7 @@ config = qwen3_30b_a3b_pretrain_config(
239239
train_iters=500_000,
240240
global_batch_size=2048,
241241
seq_length=4096,
242-
# Uses TP=1, PP=1, EP=8 (8 GPUs) automatically
242+
# Uses TP=1, PP=1, EP=16 (16 GPUs) automatically
243243
)
244244
```
245245

@@ -272,7 +272,7 @@ config = qwen3_30b_a3b_sft_config(
272272
train_iters=1000,
273273
global_batch_size=64,
274274
finetune_lr=5e-6,
275-
# Uses TP=1, PP=1, EP=8 (8 GPUs) automatically
275+
# Uses TP=1, PP=1, EP=16 (16 GPUs) automatically
276276
)
277277
```
278278

@@ -288,7 +288,7 @@ config = qwen3_30b_a3b_peft_config(
288288
train_iters=1000,
289289
global_batch_size=128,
290290
finetune_lr=1e-4,
291-
# Uses TP=1, PP=1, EP=8 (8 GPUs) automatically
291+
# Uses TP=4, PP=1, EP=4 (4 GPUs) automatically
292292
)
293293
```
294294

docs/fern/versions/nightly/pages/models/qwen/qwen3-vl.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ We use the following environment variables throughout this page
1010
- `MEGATRON_MODEL_PATH=/models/Qwen3-VL-8B-Instruct` (feel free to set your own path)
1111
Unless explicitly stated, any megatron model path in the commands below should NOT contain the iteration number
1212
`iter_xxxxxx`. For more details on checkpointing, please see
13-
[here](../../training/checkpointing.md#checkpoint-contents)
13+
[here](../../training/checkpointing.md#checkpoint-contents)
1414

1515
</Tip>
1616

docs/models/qwen/qwen.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -218,9 +218,9 @@ uv run python examples/conversion/hf_to_megatron_generate_text.py \
218218

219219
| Model | Mode | TP | PP | EP | Total GPUs | Use Case |
220220
|-------|------|----|----|----|-----------:|----------|
221-
| **Qwen3-30B-A3B** | Pretrain | 1 | 1 | 8 | 8 | Pre-training (single node) |
222-
| **Qwen3-30B-A3B** | Full SFT | 1 | 1 | 8 | 8 | Full supervised finetuning |
223-
| **Qwen3-30B-A3B** | LoRA/DoRA | 1 | 1 | 8 | 8 | PEFT finetuning (single node) |
221+
| **Qwen3-30B-A3B** | Pretrain | 1 | 1 | 16 | 16 | Pre-training (2 nodes) |
222+
| **Qwen3-30B-A3B** | Full SFT | 1 | 1 | 16 | 16 | Full supervised finetuning (2 nodes) |
223+
| **Qwen3-30B-A3B** | LoRA/DoRA | 4 | 1 | 4 | 4 | PEFT finetuning |
224224
| **Qwen3-235B-A22B** | Pretrain | 2 | 8 | 32 | 512 | Pre-training (64 nodes) |
225225
| **Qwen3-235B-A22B** | Full SFT | 2 | 8 | 32 | 512 | Full supervised finetuning (64 nodes) |
226226
| **Qwen3-235B-A22B** | LoRA/DoRA | 2 | 8 | 32 | 512 | PEFT finetuning (64 nodes) |
@@ -239,7 +239,7 @@ config = qwen3_30b_a3b_pretrain_config(
239239
train_iters=500_000,
240240
global_batch_size=2048,
241241
seq_length=4096,
242-
# Uses TP=1, PP=1, EP=8 (8 GPUs) automatically
242+
# Uses TP=1, PP=1, EP=16 (16 GPUs) automatically
243243
)
244244
```
245245

@@ -272,7 +272,7 @@ config = qwen3_30b_a3b_sft_config(
272272
train_iters=1000,
273273
global_batch_size=64,
274274
finetune_lr=5e-6,
275-
# Uses TP=1, PP=1, EP=8 (8 GPUs) automatically
275+
# Uses TP=1, PP=1, EP=16 (16 GPUs) automatically
276276
)
277277
```
278278

@@ -288,7 +288,7 @@ config = qwen3_30b_a3b_peft_config(
288288
train_iters=1000,
289289
global_batch_size=128,
290290
finetune_lr=1e-4,
291-
# Uses TP=1, PP=1, EP=8 (8 GPUs) automatically
291+
# Uses TP=4, PP=1, EP=4 (4 GPUs) automatically
292292
)
293293
```
294294

docs/models/qwen/qwen3-vl.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ We use the following environment variables throughout this page
1010
- `MEGATRON_MODEL_PATH=/models/Qwen3-VL-8B-Instruct` (feel free to set your own path)
1111
Unless explicitly stated, any megatron model path in the commands below should NOT contain the iteration number
1212
`iter_xxxxxx`. For more details on checkpointing, please see
13-
[here](../../training/checkpointing.md#checkpoint-contents)
13+
[here](../../training/checkpointing.md#checkpoint-contents)
1414
```
1515

1616
## Examples
@@ -20,4 +20,4 @@ For checkpoint conversion, inference, finetuning recipes, and step-by-step train
2020
## Hugging Face Model Cards
2121
- Qwen3-VL-8B: `https://huggingface.co/Qwen/Qwen3-VL-8B-Instruct`
2222
- Qwen3-VL-30B-A3B (MoE): `https://huggingface.co/Qwen/Qwen3-VL-30B-A3B-Instruct`
23-
- Qwen3-VL-235B-A22B (MoE): `https://huggingface.co/Qwen/Qwen3-VL-235B-A22B-Instruct`
23+
- Qwen3-VL-235B-A22B (MoE): `https://huggingface.co/Qwen/Qwen3-VL-235B-A22B-Instruct`

0 commit comments

Comments
 (0)