Qwen3.5 dev fix 27b head shape support#3119

Closed

IzacharyI wants to merge 3 commits into

ROCm:Qwen3.5_devfrom

IzacharyI:Qwen3.5_dev_fix_27b_head_shape_support

Commits on Apr 23, 2026

[feat]hip inline asm for GDN linear attn in decode phase

IzacharyI
authored and
root
committed
[opt]Hoist GDN state transpose to backend-level multi-layer batched kernel

IzacharyI
authored and
root
committed

Commits on May 6, 2026

[fix]Acc issue in qwen 27b, fallback linear attn into flydsl in different head shapes which have not been included in hip inline asm dispatch. And flydsl cherrypick from PR #2682

IzacharyI
authored and
root
committed