Skip to content

Commit deeb20b

Browse files
authored
ltxvid instruction update (#214)
* ltx instruction update * updated whatsnew * updated table of contents * changed order
1 parent 80771b1 commit deeb20b

1 file changed

Lines changed: 15 additions & 2 deletions

File tree

README.md

Lines changed: 15 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,7 @@
1717
[![Unit Tests](https://github.com/google/maxtext/actions/workflows/UnitTests.yml/badge.svg)](https://github.com/google/maxdiffusion/actions/workflows/UnitTests.yml)
1818

1919
# What's new?
20+
- **`2025/7/29`**: LTX-Video text2vid generation is now supported.
2021
- **`2025/04/17`**: Flux Finetuning.
2122
- **`2025/02/12`**: Flux LoRA for inference.
2223
- **`2025/02/08`**: Flux schnell & dev inference.
@@ -41,6 +42,7 @@ MaxDiffusion supports
4142
* Load Multiple LoRA (SDXL inference).
4243
* ControlNet inference (Stable Diffusion 1.4 & SDXL).
4344
* Dreambooth training support for Stable Diffusion 1.x,2.x.
45+
* LTX-Video text2vid (inference).
4446

4547

4648
# Table of Contents
@@ -53,6 +55,7 @@ MaxDiffusion supports
5355
- [Training](#training)
5456
- [Dreambooth](#dreambooth)
5557
- [Inference](#inference)
58+
- [LTX-Video](#ltx-video)
5659
- [Flux](#flux)
5760
- [Fused Attention for GPU:](#fused-attention-for-gpu)
5861
- [Hyper SDXL LoRA](#hyper-sdxl-lora)
@@ -171,7 +174,16 @@ To generate images, run the following command:
171174
```bash
172175
python -m src.maxdiffusion.generate src/maxdiffusion/configs/base21.yml run_name="my_run"
173176
```
174-
177+
## LTX-Video
178+
- In the folder src/maxdiffusion/models/ltx_video/utils, run:
179+
```bash
180+
python convert_torch_weights_to_jax.py --ckpt_path [LOCAL DIRECTORY FOR WEIGHTS] --transformer_config_path ../xora_v1.2-13B-balanced-128.json
181+
```
182+
- In the repo folder, run:
183+
```bash
184+
python src/maxdiffusion/generate_ltx_video.py src/maxdiffusion/configs/ltx_video.yml output_dir="[SAME DIRECTORY]" config_path="src/maxdiffusion/models/ltx_video/xora_v1.2-13B-balanced-128.json"
185+
```
186+
- Other generation parameters can be set in ltx_video.yml file.
175187
## Flux
176188

177189
First make sure you have permissions to access the Flux repos in Huggingface.
@@ -205,7 +217,6 @@ To generate images, run the following command:
205217
```bash
206218
python src/maxdiffusion/generate_flux.py src/maxdiffusion/configs/base_flux_schnell.yml jax_cache_dir=/tmp/cache_dir run_name=flux_test output_dir=/tmp/ prompt="photograph of an electronics chip in the shape of a race car with trillium written on its side" per_device_batch_size=1 ici_data_parallelism=1 ici_fsdp_parallelism=-1 offload_encoders=False
207219
```
208-
209220
## Fused Attention for GPU:
210221
Fused Attention for GPU is supported via TransformerEngine. Installation instructions:
211222

@@ -322,3 +333,5 @@ This script will automatically format your code with `pyink` and help you identi
322333
323334
324335
The full suite of -end-to end tests is in `tests` and `src/maxdiffusion/tests`. We run them with a nightly cadance.
336+
337+

0 commit comments

Comments
 (0)