Commit e47ca81
committed
feat: trim glm5.2 b300 DEP arm to conc 48 only / 将 glm5.2 b300 DEP 分支收敛为仅 conc 48
The sweep (run 29717273540) showed DEP conc 48 is the frontier peak
(163 tok/s/gpu out, ttft 2.8s, GPU radix hit 0.93) while conc 64 overflows
the HBM+host radix cache (hit collapses to 0.57), thrashing on re-prefill
down to 41 tok/s/gpu at 56s ttft. conc 64 is strictly dominated by conc 48
on both throughput and interactivity and cannot be recovered without more
host-pool capacity than the 3TB node can give (ratio > 0.75 OOMs, per
#2279). Drop it: DEP arm conc-list is now [48]. The agentic eval also moves
to conc 48 (off the conc-64 point whose eval hung).
中文:扫描(run 29717273540)显示 DEP conc 48 是前沿峰值(输出 163 tok/s/gpu,
ttft 2.8s,GPU radix 命中 0.93),而 conc 64 会使 HBM+host radix 缓存溢出(命中
率跌至 0.57),陷入 re-prefill 抖动,降至 41 tok/s/gpu、ttft 56s。conc 64 在吞吐
与交互性两个维度上都被 conc 48 严格支配,且在 3TB 节点上无法通过增大 host pool
恢复(ratio > 0.75 会 OOM,见 #2279)。故移除:DEP 分支 conc-list 现为 [48]。
agentic 评估点也随之移到 conc 48(避开评估卡住的 conc 64 点)。1 parent 0e363a6 commit e47ca81
2 files changed
Lines changed: 6 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
7875 | 7875 | | |
7876 | 7876 | | |
7877 | 7877 | | |
7878 | | - | |
7879 | | - | |
| 7878 | + | |
| 7879 | + | |
| 7880 | + | |
| 7881 | + | |
| 7882 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4971 | 4971 | | |
4972 | 4972 | | |
4973 | 4973 | | |
4974 | | - | |
| 4974 | + | |
4975 | 4975 | | |
4976 | 4976 | | |
0 commit comments