File tree Expand file tree Collapse file tree
docs/tutorials/posttraining Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -126,6 +126,20 @@ The overview of what this run will do is as follows:
1261264 . Evaluate the policy model's performance on GSM8K math reasoning benchmark
127127 after the post-training with GRPO.
128128
129+ By default, the above command will train the model using GRPOLearner from Tunix. To enable
130+ asynchronous RL training with AgenticGRPOLearner, we can set ` rl.use_agentic_rollout ` to
131+ true. An example command will be:
132+
133+ ```
134+ python3 -m maxtext.trainers.post_train.rl.train_rl \
135+ model_name=${MODEL?} \
136+ load_parameters_path=${MAXTEXT_CKPT_PATH?} \
137+ run_name=${RUN_NAME?} \
138+ base_output_directory=${BASE_OUTPUT_DIRECTORY?} \
139+ chips_per_vm=${CHIPS_PER_VM?} \
140+ rl.use_agentic_rollout=True
141+ ```
142+
129143## Run GSPO
130144
131145Run the following command for GSPO:
You can’t perform that action at this time.
0 commit comments