Skip to content

Commit 6e97ecc

Browse files
authored
[XPU] Enable custom routing functions in IPEX for Llama4 (vllm-project#28004)
Signed-off-by: frost-intel <frost.mitchell@intel.com>
1 parent 6ab1838 commit 6e97ecc

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

  • vllm/model_executor/layers/fused_moe

vllm/model_executor/layers/fused_moe/layer.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -915,7 +915,6 @@ def forward_xpu(
915915
or logical_replica_count is not None
916916
):
917917
raise NotImplementedError("Expert load balancing is not supported for XPU.")
918-
assert custom_routing_function is None
919918
return layer.ipex_fusion(
920919
x,
921920
use_grouped_topk,
@@ -924,6 +923,7 @@ def forward_xpu(
924923
renormalize,
925924
topk_group,
926925
num_expert_group,
926+
custom_routing_function=custom_routing_function,
927927
)
928928

929929
def forward_tpu(

0 commit comments

Comments
 (0)