fix: use prompt token length for advantage group extraction and fix token mask#2176

Merged

yuki-97 merged 3 commits into

mainfrom

yifu/fix-prompt-extraction-multi-turn

May 27, 2026

Commits on May 26, 2026

fix: use prompt token length for advantage group extraction

authored and
macandro96
committed
fix: only train on generated assistant turns

Anish Mahishi
authored and
macandro96
committed
fix: align sync rollout prompt extraction with grpo

Anish Mahishi
authored and
macandro96
committed