Skip to content

Commit 7f5db1a

Browse files
committed
minor fix
1 parent 4720c3e commit 7f5db1a

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

src/maxtext/checkpoint_conversion/utils/hf_model_configs.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -724,13 +724,13 @@
724724
attention_dropout=0.0,
725725
bos_token_id=151643,
726726
decoder_sparse_step=1,
727-
eos_token_id=151645,
727+
eos_token_id=151643,
728728
head_dim=128,
729729
hidden_act="silu",
730730
hidden_size=2048,
731731
initializer_range=0.02,
732732
intermediate_size=6144,
733-
max_position_embeddings=40960,
733+
max_position_embeddings=32768,
734734
max_window_layers=48,
735735
mlp_only_layers=[],
736736
model_type="qwen3_moe",

0 commit comments

Comments
 (0)