Skip to content

Commit 532db2c

Browse files
committed
Shard txt_ids_val and img_ids_val across data_sharding for multi-host batch alignment
1 parent 61721d9 commit 532db2c

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

src/maxdiffusion/pipelines/flux/flux2klein_pipeline.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -254,6 +254,8 @@ def put_data_on_devices(x, sharding):
254254

255255
latents_jax = put_data_on_devices(latents_jax, data_sharding)
256256
prompt_embeds_jax = put_data_on_devices(prompt_embeds_jax, data_sharding)
257+
txt_ids_val = put_data_on_devices(txt_ids_val, data_sharding)
258+
img_ids_val = put_data_on_devices(img_ids_val, data_sharding)
257259

258260
# ---------------------------------------------------------------------
259261
# PHASE B: Denoising Loop (Flux Transformer - Fused JAX fori_loop)

0 commit comments

Comments
 (0)