Skip to content

Commit 2afffd0

Browse files
committed
accomodate renaming of include_tokens_per_second to include_num_input_tokens_seen
1 parent 3be4589 commit 2afffd0

2 files changed

Lines changed: 6 additions & 3 deletions

File tree

tests/build/test_launch_script.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,8 @@
5151
"warmup_ratio": 0.03,
5252
"lr_scheduler_type": "cosine",
5353
"logging_steps": 1,
54-
"include_tokens_per_second": True,
54+
# "include_tokens_per_second": True,
55+
"include_num_input_tokens_seen": True,
5556
"packing": False,
5657
"response_template": "\n### Label:",
5758
"dataset_text_field": "output",

tests/test_sft_trainer.py

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -124,7 +124,8 @@
124124
warmup_ratio=0.03,
125125
lr_scheduler_type="cosine",
126126
logging_steps=1,
127-
include_tokens_per_second=True,
127+
# include_tokens_per_second=True,
128+
include_num_input_tokens_seen=True,
128129
packing=False,
129130
max_seq_length=4096,
130131
save_strategy="epoch",
@@ -140,7 +141,8 @@
140141
warmup_ratio=0.03,
141142
lr_scheduler_type="cosine",
142143
logging_steps=1,
143-
include_tokens_per_second=True,
144+
# include_tokens_per_second=True,
145+
include_num_input_tokens_seen=True,
144146
packing=False,
145147
max_seq_length=4096,
146148
save_strategy="epoch",

0 commit comments

Comments
 (0)