Split kv decode#146

Merged

sunjiweiswift merged 25 commits into

split_kv_decodefrom

copilot/sub-pr-145

Mar 24, 2026

Commits on Mar 18, 2026

Split FMHA decode and GroupGemm template instantiations into per-kernel compilation units (#140)

authored

Commits on Mar 20, 2026

Fix noncontiguous input for rmsnorm (#117)
yangw1234
authored

Commits on Mar 23, 2026

Add MXFP4 Per Token Group Quant kernel and tests (#106)

sspintel
and
airMeng
authored
add page 64
sunjiweiswift
committed
Initial plan
Copilot
committed
add reduce.h

sunjiweiswift
authored and
Copilot
committed
add XeFMHAFwdSplitKVKernel

sunjiweiswift
authored and
Copilot
committed
const tensor for Q

sunjiweiswift
authored and
Copilot
committed
add split kernel

sunjiweiswift
authored and
Copilot
committed
save

sunjiweiswift
authored and
Copilot
committed
cache_seqlens

sunjiweiswift
authored and
Copilot
committed
head_dim =128

sunjiweiswift
authored and
Copilot
committed
2026

sunjiweiswift
authored and
Copilot
committed
test for mingxu

sunjiweiswift
authored and
Copilot
committed
Initial plan
Copilot
committed
Rebase onto main: integrate split-KV changes into flash_attention.cpp and fix SplitDeodeConfig typo
Copilot
committed
Merge remote after rebase onto main
Copilot
committed
Rebase onto updated split_kv_decode: fix FMHAConfig undefined, add conditional dispatch between DecodeConfig and SplitDecodeConfig, comment out page_size 32

Copilot
and
sunjiweiswift
committed
Merge origin/split_kv_decode: resolve conflicts, rename kernel_dispatch to run
Copilot
committed

Commits on Mar 24, 2026