Skip to content

Commit a35a042

Browse files
committed
polish
Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
1 parent 7612abe commit a35a042

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

modelopt/torch/speculative/plugins/megatron_eagle.py

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -735,6 +735,11 @@ def modify(
735735
self.eagle_config.hidden_size = self.config.hidden_size
736736
self.eagle_config.vocab_size = self.vocab_size
737737
self.eagle_config.max_sequence_length = self.max_sequence_length
738+
self.eagle_config.draft_vocab_size = (
739+
self.vocab_size
740+
if self.eagle_config.draft_vocab_size is None
741+
else self.eagle_config.draft_vocab_size
742+
)
738743

739744
if draft_vocab_cache is not None:
740745
if not os.path.isfile(draft_vocab_cache):

0 commit comments

Comments
 (0)