[OPUS] Absorb module_rmsnorm_quant into the opus rmsnorm module#4080

Open

carlushuang wants to merge 62 commits into

carlushuang:carhuang/rmsnorm-opus-quant

Commits on Jul 2, 2026

Add torch-free opus RMSNorm backend (module_rmsnorm_opus)
carlushuang
committed
Condense comments in opus rmsnorm sources
carlushuang
committed
Drop aiter_tensor.h: raw-pointer ctypes ABI + hip_minimal + __HIPCC_RTC__
carlushuang
committed
Cache row in registers to avoid double global read (single-pass)
carlushuang
committed
Full CK parity: opus dynamic/smooth quant (int8/fp8), T5, save-unquant
carlushuang
committed
Pack multiple rows per block for small hidden (2D block + segmented reduce)
carlushuang
committed
Condense: merge plain + fused-add into one kernel, tighten comments
carlushuang
committed
Add opus mirrors of the CK entrypoints (symmetric _ck / _opus dispatch)
carlushuang
committed
Match CK exactly for fused-add: fp32 norm-input in default, rounded in T5
carlushuang
committed
Bit-exact vs CK for bf16 rmsnorm on the vn=8 tile buckets
carlushuang
committed
be-kernel: use scalar fp32 norm-input array (fp16 closer to CK)
carlushuang
committed
be-kernel: revert explicit fmaf (no fp16 gain); keep plain squared-sum
carlushuang
committed
Inline opus into rmsnorm.py (drop rmsnorm_opus.py); make opus the default
carlushuang
committed

Commits on Jul 3, 2026

Commits on Jul 4, 2026

Commits on Jul 5, 2026

Commits on Jul 7, 2026

Commits on Jul 13, 2026

Merge remote-tracking branch 'origin/main' into carhuang/rmsnorm-opus-quant
carlushuang
committed