Skip to content

[MoE]Support 3D router output shape.#36914

Open
intelgaoxiong wants to merge 1 commit into
openvinotoolkit:masterfrom
intelgaoxiong:xiong/moe_3d_layout
Open

[MoE]Support 3D router output shape.#36914
intelgaoxiong wants to merge 1 commit into
openvinotoolkit:masterfrom
intelgaoxiong:xiong/moe_3d_layout

Conversation

@intelgaoxiong

@intelgaoxiong intelgaoxiong commented Jul 16, 2026

Copy link
Copy Markdown
Contributor

Details:

This PR extends to support 3D Router shape.

  • Originally, we expect router shape in 4D [num_experts, 1, token_count, 1] or [num_experts, token_count, 1, 1].
  • Gemma4 MoE and Qwen3 GQ MoE have 3D Router shape [num_experts, token_count, 1].

Tickets:

AI Assistance:

  • AI assistance used: no / yes
  • If yes, summarize how AI was used and what human validation was performed (build/tests/manual checks).

@intelgaoxiong intelgaoxiong requested review from a team as code owners July 16, 2026 07:15
@github-actions github-actions Bot added category: NPU OpenVINO NPU plugin category: NPUW NPUW plugin labels Jul 16, 2026
@intelgaoxiong intelgaoxiong force-pushed the xiong/moe_3d_layout branch 2 times, most recently from 33c9b15 to 0f2b194 Compare July 16, 2026 09:06
Signed-off-by: intelgaoxiong <xiong.gao@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

category: NPU OpenVINO NPU plugin category: NPUW NPUW plugin

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant