Add MoE to Gemma4 TP plan#45219

Cyrilvallez merged 2 commits intohuggingface:mainhuggingface/transformers:mainfrom

sywangyi:reduce_memory_gemma4sywangyi/transformers:reduce_memory_gemma4Copy head branch name to clipboard