Release/v26.5#90

Merged

yeandy merged 3 commits into

ROCm:release/v26.5from

yeandy:release/v26.5

Jun 18, 2026

Commits on Jun 17, 2026

Make MoE dispatch/MLP expert-axis batch sharding configurable

gulsumgudukbay
authored and
yeandy
committed
Enable moe_dispatch_no_expert_sharding for mixtral-8x22b. Same 8-large-expert geometry as 8x7b, so it benefits from the same expert-parallel MoE dispatch/MLP sharding.

gulsumgudukbay
authored and
yeandy
committed
Add MoE dispatch expert-sharding regression test. Asserts that with moe_dispatch_no_expert_sharding the expert dim is sharded by 'expert' and the batch dim is not, guarding the expert-parallel disp…

gulsumgudukbay
authored and
yeandy
committed