Skip to content

Add interleave mode for split qkv norm rope#503

Merged
iforgetmyname merged 2 commits into
sgl-project:mainfrom
McZyWu:split-norm-rope-interleave
May 27, 2026
Merged

Add interleave mode for split qkv norm rope#503
iforgetmyname merged 2 commits into
sgl-project:mainfrom
McZyWu:split-norm-rope-interleave

Commits

Commits on May 19, 2026