Skip to content

Commit 5475ecc

Browse files
committed
fix coderabbit comments
Signed-off-by: Brenden Elgarten <belgarten@nvidia.com>
1 parent 1c7e390 commit 5475ecc

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

tensorrt_llm/_torch/visual_gen/models/flux/joint_proj.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -257,7 +257,7 @@ def range_size(r):
257257
"up": (local_mlp_hidden_start, local_mlp_hidden_end),
258258
},
259259
)
260-
self.local_qkv_dim = (q_dim + 2 * kv_dim) // self.tp_size
260+
self.local_qkv_dim = local_q_dim + 2 * local_kv_dim
261261
self.local_mlp_dim = local_mlp_hidden_size
262262

263263
def forward(self, x: torch.Tensor) -> Tuple[torch.Tensor, torch.Tensor]:

0 commit comments

Comments
 (0)