Commit 81c4cb3
Fix per-frame timestep allocation for video2world mode in CosmosPredict2
In video2world (image2world) mode, conditioning frames were receiving the
same noisy timestep as all other frames. This caused the transformer to
treat the clean conditioning frame as a fully-noised input, breaking
temporal coherence and causing severe quality degradation.
Fix: after replacing conditioning frames in model_input, expand t to
shape (B, T) and zero out timesteps for frames where condition_mask=1,
signaling to the model that those frames are already clean (t=0).
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>1 parent 123e6a2 commit 81c4cb3
1 file changed
Lines changed: 7 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1352 | 1352 | | |
1353 | 1353 | | |
1354 | 1354 | | |
| 1355 | + | |
| 1356 | + | |
| 1357 | + | |
| 1358 | + | |
| 1359 | + | |
| 1360 | + | |
| 1361 | + | |
1355 | 1362 | | |
1356 | 1363 | | |
1357 | 1364 | | |
| |||
0 commit comments