Skip to content

Commit 8de36c3

Browse files
committed
Add DPO correctness integration test and respect dpo.max_prompt_length in train_dpo.py
1 parent f23ae97 commit 8de36c3

3 files changed

Lines changed: 498 additions & 0 deletions

File tree

.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -155,3 +155,4 @@ gha-creds-*.json
155155

156156
# vscode workspace
157157
maxtext.code-workspace
158+
maxtext_output/

src/maxtext/trainers/post_train/dpo/train_dpo.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -91,6 +91,7 @@ def get_tunix_config(mt_config: MaxTextConfig) -> DPOTrainingConfig:
9191
set_profile_options=set_profile_options,
9292
)
9393

94+
9495
return DPOTrainingConfig(
9596
eval_every_n_steps=mt_config.eval_interval,
9697
max_steps=mt_config.steps,

0 commit comments

Comments
 (0)