Skip to content

Commit a2b9861

Browse files
committed
update vllm.yml after rebasing
1 parent efbee87 commit a2b9861

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

src/maxtext/configs/inference/vllm.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -70,6 +70,8 @@ logical_axis_rules: [
7070
['kv', []],
7171
['embed', ['expert', 'attn_dp_expert']],
7272
['embed', ['attn_dp_expert']],
73+
['embed_moe', ['expert', 'attn_dp_expert']],
74+
['embed_moe', ['attn_dp_expert']],
7375
['embed_tensor_transpose', ['attn_dp', 'model']],
7476
['embed_no_exp', []],
7577
['embed_no_exp_moe', []],

0 commit comments

Comments
 (0)