Commit 436ea72
committed
Fix: route GEMMA4 output_norm to ctx_output instead of ctx_output_split
I mistakenly added routed
output_norm for GEMMA4 and GEMMA4_MTP to ctx_output_split.
output_norm is a 1D vector that gains no benefit from being split
across GPUs and incurs unnecessary communication overhead.
Reverted it to ctx_output instead.1 parent 92900a3 commit 436ea72
1 file changed
Lines changed: 2 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2153 | 2153 | | |
2154 | 2154 | | |
2155 | 2155 | | |
2156 | | - | |
| 2156 | + | |
2157 | 2157 | | |
2158 | 2158 | | |
2159 | 2159 | | |
| |||
2239 | 2239 | | |
2240 | 2240 | | |
2241 | 2241 | | |
2242 | | - | |
| 2242 | + | |
2243 | 2243 | | |
2244 | 2244 | | |
2245 | 2245 | | |
| |||
0 commit comments