Skip to content

Commit 913d0c3

Browse files
authored
[lora][moe] fix MoE models by registering the correct op (#1599)
Signed-off-by: AlpinDale <alpindale@gmail.com>
1 parent eb82a1c commit 913d0c3

1 file changed

Lines changed: 4 additions & 4 deletions

File tree

aphrodite/_custom_ops.py

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1705,8 +1705,6 @@ def moe_align_block_size(
17051705
sorted_token_ids: torch.Tensor,
17061706
experts_ids: torch.Tensor,
17071707
num_tokens_post_pad: torch.Tensor,
1708-
adapter_enabled: torch.Tensor,
1709-
lora_ids: torch.Tensor,
17101708
) -> None:
17111709
torch.ops._moe_C.moe_align_block_size(
17121710
topk_ids,
@@ -1715,8 +1713,6 @@ def moe_align_block_size(
17151713
sorted_token_ids,
17161714
experts_ids,
17171715
num_tokens_post_pad,
1718-
adapter_enabled,
1719-
lora_ids,
17201716
)
17211717

17221718

@@ -1749,6 +1745,8 @@ def moe_lora_align_block_size(
17491745
sorted_token_ids: torch.Tensor,
17501746
experts_ids: torch.Tensor,
17511747
num_tokens_post_pad: torch.Tensor,
1748+
adapter_enabled: torch.Tensor,
1749+
lora_ids: torch.Tensor,
17521750
) -> None:
17531751
torch.ops._moe_C.moe_lora_align_block_size(
17541752
topk_ids,
@@ -1761,6 +1759,8 @@ def moe_lora_align_block_size(
17611759
sorted_token_ids,
17621760
experts_ids,
17631761
num_tokens_post_pad,
1762+
adapter_enabled,
1763+
lora_ids,
17641764
)
17651765

17661766

0 commit comments

Comments
 (0)