feat: Add pinned memory optimizer offload for Megatron policy worker#2248

Open

snivertynv wants to merge 5 commits intomainfrom

sniverty/optimizer_offload_perf

Commits on Apr 30, 2026

Add pinned memory optimizer offload for Megatron policy worker. Controlled using the use_pinned_optimizer_offload setting - set to false in a couple of grpo_math* yaml configs as an example. Added …
snivertynv
committed
fix: address PR review feedback for pinned optimizer offload
snivertynv
committed
fix: revert accidental submodule pointer downgrades
snivertynv
committed

Commits on May 1, 2026