Commit 5baf0d5
fix(agentic-mtp): stop dividing CUDA_GRAPH_MAX_BS by TP for DPA
Remove the per-DP-rank division of CUDA_GRAPH_MAX_BS — keep it at CONC
so decode batches up to the concurrency level stay on the CUDA graph
fast path (was dropping from 52 to 7 with TP8).
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>1 parent c33e79f commit 5baf0d5
1 file changed
Lines changed: 1 addition & 3 deletions
Lines changed: 1 addition & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
113 | 113 | | |
114 | 114 | | |
115 | 115 | | |
| 116 | + | |
116 | 117 | | |
117 | | - | |
118 | | - | |
119 | | - | |
120 | 118 | | |
121 | 119 | | |
122 | 120 | | |
| |||
0 commit comments