Skip to content

Commit 9a04d58

Browse files
committed
docs(rl): update tutorial with AgenticGRPOLearner for async RL training
1 parent 008b02a commit 9a04d58

1 file changed

Lines changed: 14 additions & 0 deletions

File tree

  • docs/tutorials/posttraining

docs/tutorials/posttraining/rl.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -126,6 +126,20 @@ The overview of what this run will do is as follows:
126126
4. Evaluate the policy model's performance on GSM8K math reasoning benchmark
127127
after the post-training with GRPO.
128128

129+
By default, the above command will train the model using GRPOLearner from Tunix. To enable
130+
asynchronous RL training with AgenticGRPOLearner, we can set `rl.use_agentic_rollout` to
131+
true. An example command will be:
132+
133+
```
134+
python3 -m maxtext.trainers.post_train.rl.train_rl \
135+
model_name=${MODEL?} \
136+
load_parameters_path=${MAXTEXT_CKPT_PATH?} \
137+
run_name=${RUN_NAME?} \
138+
base_output_directory=${BASE_OUTPUT_DIRECTORY?} \
139+
chips_per_vm=${CHIPS_PER_VM?} \
140+
rl.use_agentic_rollout=True
141+
```
142+
129143
## Run GSPO
130144

131145
Run the following command for GSPO:

0 commit comments

Comments
 (0)