Skip to content

Commit 3b5d7f9

Browse files
Change tokenizer to chat tokenizer for SFT trainer tests (GoogleCloudPlatform#737)
1 parent 246a49c commit 3b5d7f9

1 file changed

Lines changed: 2 additions & 5 deletions

File tree

dags/multipod/maxtext_sft_trainer.py

Lines changed: 2 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -44,14 +44,11 @@
4444
command = (
4545
f'export HF_TOKEN={HF_TOKEN}',
4646
'export PRE_TRAINED_MODEL=llama2-7b',
47-
'export PRE_TRAINED_MODEL_TOKENIZER=meta-llama/Llama-2-7b-hf',
48-
'export PRE_TRAINED_MODEL_CKPT_PATH=gs://maxtext-model-checkpoints/llama2-7b/2025-01-23-19-26/scanned/0/items',
47+
'export PRE_TRAINED_MODEL_TOKENIZER=meta-llama/Llama-2-7b-chat-hf',
48+
'export PRE_TRAINED_MODEL_CKPT_PATH=gs://maxtext-model-checkpoints/llama2-7b-chat/scanned/0/items',
4949
f'export BASE_OUTPUT_DIRECTORY={base_output_directory}',
5050
'export STEPS=2500',
5151
'export PROMPT="Suggest some famous landmarks in London."',
52-
'export RTOL=1e-05',
53-
'export ATOL=0.09',
54-
'export KL_DIV=7e-05',
5552
'bash end_to_end/tpu/test_sft_trainer.sh',
5653
)
5754
maxtext_v4_configs_test = gke_config.get_gke_config(

0 commit comments

Comments
 (0)