Skip to content

Add nvfp4 attention support for vLLM serving#1898

Merged
kaix-nv merged 24 commits into
mainfrom
kaix/sparse_attn_quant_compact
Jul 16, 2026
Merged

Add nvfp4 attention support for vLLM serving#1898
kaix-nv merged 24 commits into
mainfrom
kaix/sparse_attn_quant_compact

Add per-operand FP8 attention quant formats for Q/K/P/V

c4e2146
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jul 15, 2026 in 1s

DCO

All commits are signed off!