Image prefill is not working as expected if image is attached in the first messgae

[kamalkraj]

Screen_recording_20260126_122336.mp4

@kirklandsign

[kirklandsign]

Hi @kamalkraj are you using gemma? Mind sharing how you got the model?

I can repro this with gemma, but llava seems to work.

[kamalkraj]

@kirklandsign

optimum-cli export executorch \
  --model "google/gemma-3-4b-it" \
  --task "multimodal-text-to-text" \
  --recipe "xnnpack" \
  --device cpu \
  --use_custom_sdpa \
  --use_custom_kv_cache \
  --qlinear 8da4w \
  --qlinear_group_size 32 \
  --qlinear_encoder "8da4w,8da8w" \
  --qlinear_encoder_group_size 32 \
  --qembedding "8w" \
  --qembedding_encoder "8w" \
  --output_dir="gemma-3-4b-it-8da4w-executorch-fullseq"

[kirklandsign]

@kamalkraj Thanks! I can repro this. Just curious, does llava work for you?

[kamalkraj]

Not tried

[kirklandsign]

#181 should fix this issue