Skip to content

Commit b9fa538

Browse files
authored
Drop historical sample counts
1 parent 646816a commit b9fa538

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

fms_fsdp/utils/dataset_utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1366,7 +1366,7 @@ def __init__(
13661366
self.tokens_seen = [0] * len(self.datasets)
13671367

13681368
self.current_iterator = -1
1369-
self.state_params = ["tokens_seen", "current_iterator"]
1369+
self.state_params = ["current_iterator"]
13701370

13711371
def setup(self):
13721372
if not self.is_setup:

0 commit comments

Comments
 (0)