Skip to content

Commit a34eabf

Browse files
authored
Merge pull request #269 from AI-Hypercomputer/fix-kimi-k2-nemo2604
Fix A4X MAX Kimi-k2 directory path naming
2 parents 594fc15 + 4907ee6 commit a34eabf

25 files changed

Lines changed: 18 additions & 2 deletions

README.md

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -112,6 +112,22 @@ Models | GPU Machine Type
112112
**Qwen-3-30B** | [A4X (NVIDIA GB200)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4x-vms) | Megatron-Bridge (25.11) | Pre-training | Slurm | [Link](./training/a4x/qwen3_30b_a3b/megatron-bridge-slurm/nemo2511/)
113113

114114

115+
### Training benchmarks A4X MAX
116+
117+
Models | GPU Machine Type | Framework | Workload Type | Orchestrator | Link to the recipe
118+
------------------ | ---------------------------------------------------------------------------------------------------- | --------- | ------------- | ------------ | ------------------
119+
**DeepSeek-V3** | [A4X MAX (NVIDIA GB300)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4x-vms) | Megatron-Bridge (25.11) | Pre-training | GKE | [Link](./training/a4x-max/deepseek-v3/megatron-bridge-gke/nemo2511/)
120+
**DeepSeek-V3** | [A4X MAX (NVIDIA GB300)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4x-vms) | Megatron-Bridge (26.04) | Pre-training | GKE | [Link](./training/a4x-max/deepseek-v3/megatron-bridge-gke/nemo2604/)
121+
**DeepSeek-V3** | [A4X MAX (NVIDIA GB300)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4x-vms) | Megatron-Bridge (26.06) | Pre-training | GKE | [Link](./training/a4x-max/deepseek-v3/megatron-bridge-gke/nemo2606/)
122+
**GPT OSS 120B** | [A4X MAX (NVIDIA GB300)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4x-vms) | Megatron-Bridge (25.11) | Pre-training | GKE | [Link](./training/a4x-max/gpt-oss-120b/megatron-bridge-gke/nemo2511/)
123+
**GPT OSS 120B** | [A4X MAX (NVIDIA GB300)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4x-vms) | Megatron-Bridge (26.04) | Pre-training | GKE | [Link](./training/a4x-max/gpt-oss-120b/megatron-bridge-gke/nemo2604/)
124+
**Kimi-k2** | [A4X MAX (NVIDIA GB300)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4x-vms) | Megatron-Bridge (26.04) | Pre-training | GKE | [Link](./training/a4x-max/kimi-k2/megatron-bridge-gke/nemo2604/)
125+
**Llama-3.1-405B** | [A4X MAX (NVIDIA GB300)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4x-vms) | Megatron-Bridge (26.02) | Pre-training | GKE | [Link](./training/a4x-max/llama3-1-405b/megatron-bridge-gke/nemo2602/)
126+
**Llama-3.1-405B** | [A4X MAX (NVIDIA GB300)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4x-vms) | Megatron-Bridge (26.04) | Pre-training | GKE | [Link](./training/a4x-max/llama3-1-405b/megatron-bridge-gke/nemo2604/)
127+
**Qwen-3-235B** | [A4X MAX (NVIDIA GB300)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4x-vms) | Megatron-Bridge (26.02) | Pre-training | GKE | [Link](./training/a4x-max/qwen3-235b-a22b/megatron-bridge-gke/nemo2602/)
128+
**Qwen-3-235B** | [A4X MAX (NVIDIA GB300)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4x-vms) | Megatron-Bridge (26.04) | Pre-training | GKE | [Link](./training/a4x-max/qwen3-235b-a22b/megatron-bridge-gke/nemo2604/)
129+
**Wan-2.1-14B** | [A4X MAX (NVIDIA GB300)](https://cloud.google.com/compute/docs/accelerator-optimized-machines#a4x-vms) | Megatron-Bridge (26.02) | Pre-training | GKE | [Link](./training/a4x-max/wan21-14b/megatron-bridge-gke/nemo2602/)
130+
115131
### Inference benchmarks A3 Mega
116132

117133
| Models | GPU Machine Type | Framework | Workload Type | Orchestrator | Link to the recipe |

training/a4x-max/kimi-k2/megatron-bridge-gke/nemo260401/1024gpus-fp8mx-seq4096-gbs16384/recipe/Chart.yaml renamed to training/a4x-max/kimi-k2/megatron-bridge-gke/nemo2604/1024gpus-fp8mx-seq4096-gbs16384/recipe/Chart.yaml

File renamed without changes.

training/a4x-max/kimi-k2/megatron-bridge-gke/nemo260401/1024gpus-fp8mx-seq4096-gbs16384/recipe/README.md renamed to training/a4x-max/kimi-k2/megatron-bridge-gke/nemo2604/1024gpus-fp8mx-seq4096-gbs16384/recipe/README.md

File renamed without changes.

training/a4x-max/kimi-k2/megatron-bridge-gke/nemo260401/1024gpus-fp8mx-seq4096-gbs16384/recipe/launcher.sh renamed to training/a4x-max/kimi-k2/megatron-bridge-gke/nemo2604/1024gpus-fp8mx-seq4096-gbs16384/recipe/launcher.sh

File renamed without changes.

training/a4x-max/kimi-k2/megatron-bridge-gke/nemo260401/1024gpus-fp8mx-seq4096-gbs16384/recipe/templates/workload-config-configmap.yaml renamed to training/a4x-max/kimi-k2/megatron-bridge-gke/nemo2604/1024gpus-fp8mx-seq4096-gbs16384/recipe/templates/workload-config-configmap.yaml

File renamed without changes.

training/a4x-max/kimi-k2/megatron-bridge-gke/nemo260401/1024gpus-fp8mx-seq4096-gbs16384/recipe/templates/workload-job.yaml renamed to training/a4x-max/kimi-k2/megatron-bridge-gke/nemo2604/1024gpus-fp8mx-seq4096-gbs16384/recipe/templates/workload-job.yaml

File renamed without changes.

training/a4x-max/kimi-k2/megatron-bridge-gke/nemo260401/1024gpus-fp8mx-seq4096-gbs16384/recipe/templates/workload-launcher-configmap.yaml renamed to training/a4x-max/kimi-k2/megatron-bridge-gke/nemo2604/1024gpus-fp8mx-seq4096-gbs16384/recipe/templates/workload-launcher-configmap.yaml

File renamed without changes.

training/a4x-max/kimi-k2/megatron-bridge-gke/nemo260401/1024gpus-fp8mx-seq4096-gbs16384/recipe/templates/workload-svc.yaml renamed to training/a4x-max/kimi-k2/megatron-bridge-gke/nemo2604/1024gpus-fp8mx-seq4096-gbs16384/recipe/templates/workload-svc.yaml

File renamed without changes.

training/a4x-max/kimi-k2/megatron-bridge-gke/nemo260401/1024gpus-fp8mx-seq4096-gbs16384/recipe/values.yaml renamed to training/a4x-max/kimi-k2/megatron-bridge-gke/nemo2604/1024gpus-fp8mx-seq4096-gbs16384/recipe/values.yaml

File renamed without changes.

training/a4x-max/kimi-k2/megatron-bridge-gke/nemo260401/256gpus-fp8mx-seq4096-gbs4096/recipe/Chart.yaml renamed to training/a4x-max/kimi-k2/megatron-bridge-gke/nemo2604/256gpus-fp8mx-seq4096-gbs4096/recipe/Chart.yaml

File renamed without changes.

0 commit comments

Comments
 (0)