Skip to content

Commit d718d78

Browse files
committed
Optimize Gemma4 small decoder test config to reduce memory usage
1 parent 7d209b2 commit d718d78

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

tests/unit/nnx_decoders_test.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -796,6 +796,8 @@ def test_gemma4_small_decoder(self):
796796
"base_mlp_dim=256",
797797
"dtype=float32",
798798
"weight_dtype=float32",
799+
"hidden_size_per_layer_input=128",
800+
"vocab_size_per_layer_input=256",
799801
"vocab_size=256",
800802
],
801803
override_model_config=True,

0 commit comments

Comments
 (0)