[feat:] Add CISPO loss#2531

Open

pengdurice wants to merge 12 commits into

NVIDIA-NeMo:mainfrom

pengdurice:peng-cispo-v1

Commits on May 20, 2026

CISPO implementation

slikhite-1
authored and
pengdurice
committed
≈test cases

slikhite-1
authored and
pengdurice
committed
docs

slikhite-1
authored and
pengdurice
committed
removed assertion

slikhite-1
authored and
pengdurice
committed
assert removed

slikhite-1
authored and
pengdurice
committed
initial fix of the previous PR, add many test cases now, and will remove / check later
pengdurice
committed
only include used tests and will do more clean up later
pengdurice
committed
Fix CISPO rebase cleanup issues
pengdurice
committed