feat(trainer): add dpo#1190

Merged

garrett4wade merged 2 commits intoareal-project:mainfrom

HT-Yuan:feature/dpo-trainer

Apr 24, 2026

Commits on Apr 23, 2026

feat(trainer): add DPO trainer with FSDP backend
HT-Yuan
committed

Commits on Apr 24, 2026

fix(trainer): fix DPO config forwarding, require ref model, and correct IPO normalization
garrett4wade
committed