Skip to content

Commit 73aa3c2

Browse files
committed
add some layer
1 parent 3437373 commit 73aa3c2

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

lib/bumblebee/text/gemma4_text.ex

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -790,6 +790,8 @@ defmodule Bumblebee.Text.Gemma4Text do
790790
"model.language_model.layers.{n}.pre_feedforward_layernorm",
791791
"decoder.blocks.{n}.post_ffn_norm" =>
792792
"model.language_model.layers.{n}.post_feedforward_layernorm",
793+
"decoder.blocks.{n}.layer_scalar" =>
794+
"model.language_model.layers.{n}.layer_scalar",
793795
"decoder.blocks.{n}.ffn.gate" => "model.language_model.layers.{n}.mlp.gate_proj",
794796
"decoder.blocks.{n}.ffn.intermediate" => "model.language_model.layers.{n}.mlp.up_proj",
795797
"decoder.blocks.{n}.ffn.output" => "model.language_model.layers.{n}.mlp.down_proj",

0 commit comments

Comments
 (0)