Skip to content

Commit d3c4b11

Browse files
Do not call tokenizer.save_pretrained(), to avoid overwriting tokenizer_config.json. (#2410)
`model.save()` has already correctly saved the tokenizer. Signed-off-by: ZX-ModelCloud <zx@modelcloud.ai>
1 parent 4f95f92 commit d3c4b11

1 file changed

Lines changed: 0 additions & 1 deletion

File tree

tests/models/model_test.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -949,7 +949,6 @@ def quantModel(self, model_id_or_path, trust_remote_code=False, dtype="auto", ne
949949
self.clear_directory(path)
950950

951951
model.save(path)
952-
tokenizer.save_pretrained(path)
953952
self._print_post_quant_artifacts(path)
954953

955954
reuse_candidates = {}

0 commit comments

Comments
 (0)