Skip to content

Commit c39d38f

Browse files
committed
add README
Signed-off-by: Peter St. John <pstjohn@nvidia.com>
1 parent ccbe766 commit c39d38f

1 file changed

Lines changed: 3 additions & 3 deletions

File tree

recipes/README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -197,7 +197,7 @@ optimizer:
197197
# Distributed training
198198
distributed:
199199
backend: nccl
200-
nvfsdp:
200+
mfsdp:
201201
enable: true
202202
sharding_strategy: zero3
203203

@@ -242,7 +242,7 @@ training:
242242
num_train_steps: 100 # Enough steps for stable metrics
243243
244244
wandb:
245-
name: "esm2_nvfsdp_benchmark"
245+
name: "esm2_mfsdp_benchmark"
246246
tags: ["L1", "benchmark", "performance"]
247247
```
248248

@@ -411,7 +411,7 @@ docker run --rm -it --gpus all my_recipe pytest -v .
411411

412412
For reference implementations, examine existing recipes:
413413

414-
- **`esm2_native_te_nvfsdp/`**: Comprehensive example showing vanilla PyTorch with TE and nvFSDP
414+
- **`esm2_native_te_mfsdp/`**: Comprehensive example showing vanilla PyTorch with TE and megatron-fsdp
415415
- **`amplify_accelerate_fp8/`**: HuggingFace Accelerate integration with FP8 training
416416
- **`geneformer_lightning_context_parallel/`**: PyTorch Lightning with context parallelism for long sequences
417417

0 commit comments

Comments
 (0)