Commit 172ad96
committed
fix(gb300): reserve TP4 aggregate memory headroom
Lower gpu-memory-utilization from 0.95 to 0.94 after TP4 aggregate c1 and c8 both ran out of memory during FP4 MoE execution.
中文:将 gpu-memory-utilization 从 0.95 降至 0.94,为 GB300 TP4 聚合式 worker 预留显存余量;此前 c1 和 c8 均在执行 FP4 MoE 时发生显存不足。1 parent 303d1ef commit 172ad96
1 file changed
Lines changed: 1 addition & 1 deletion
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
115 | 115 | | |
116 | 116 | | |
117 | 117 | | |
118 | | - | |
| 118 | + | |
119 | 119 | | |
120 | 120 | | |
121 | 121 | | |
| |||
0 commit comments