-
Notifications
You must be signed in to change notification settings - Fork 7k
[modular] Add LTX Video modular pipeline #13378
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 9 commits
Commits
Show all changes
22 commits
Select commit
Hold shift + click to select a range
f357b98
Add modular pipeline support for LTX Video
akshan-main 11b891c
Fix guidance_scale passthrough to guider
akshan-main 4d2d73e
Add LTX modular pipeline tests
akshan-main 7b645e6
Add LTX image-to-video modular pipeline
akshan-main 7491d56
Fix i2v VAE dtype mismatch
akshan-main 1e53507
Add cache_context to denoiser for CFG parity
akshan-main 322727d
Address review feedback
akshan-main 4b644f7
Generate auto docstrings for LTX assembled blocks
akshan-main 3da70da
Fix ruff lint and format issues
akshan-main 38cfc86
use InputParam/OutputParam templates and ruff check
akshan-main 6c67800
Merge branch 'main' into modular-ltx
yiyixuxu 69c10cf
address all review
akshan-main d8e14c4
Merge branch 'main' into modular-ltx
yiyixuxu dc84cc8
Lift LTXVaeEncoderStep out of I2V core denoise into its own auto block
akshan-main a3d9b04
unused declarations
akshan-main a972af0
Fix check_copies: sync retrieve_timesteps and drop unsupported Copied…
akshan-main e5aeaf9
Address review: remove unused code, add LTXAutoBlocks, refactor I2V l…
akshan-main 4ffeb86
removed LTXBlocks,LTXImage2VideoBlocks
akshan-main d44f24c
Update test to use LTXAutoBlocks
akshan-main 4769f19
Merge branch 'main' into modular-ltx
yiyixuxu 310ec7c
workflow map and auto docstring
akshan-main 39f8706
Add LTXVideoPachifier, workflow map
akshan-main File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,47 @@ | ||
| from typing import TYPE_CHECKING | ||
|
|
||
| from ...utils import ( | ||
| DIFFUSERS_SLOW_IMPORT, | ||
| OptionalDependencyNotAvailable, | ||
| _LazyModule, | ||
| get_objects_from_module, | ||
| is_torch_available, | ||
| is_transformers_available, | ||
| ) | ||
|
|
||
|
|
||
| _dummy_objects = {} | ||
| _import_structure = {} | ||
|
|
||
| try: | ||
| if not (is_transformers_available() and is_torch_available()): | ||
| raise OptionalDependencyNotAvailable() | ||
| except OptionalDependencyNotAvailable: | ||
| from ...utils import dummy_torch_and_transformers_objects # noqa F403 | ||
|
|
||
| _dummy_objects.update(get_objects_from_module(dummy_torch_and_transformers_objects)) | ||
| else: | ||
| _import_structure["modular_blocks_ltx"] = ["LTXBlocks", "LTXImage2VideoBlocks"] | ||
| _import_structure["modular_pipeline"] = ["LTXModularPipeline"] | ||
|
|
||
| if TYPE_CHECKING or DIFFUSERS_SLOW_IMPORT: | ||
| try: | ||
| if not (is_transformers_available() and is_torch_available()): | ||
| raise OptionalDependencyNotAvailable() | ||
| except OptionalDependencyNotAvailable: | ||
| from ...utils.dummy_torch_and_transformers_objects import * # noqa F403 | ||
| else: | ||
| from .modular_blocks_ltx import LTXBlocks, LTXImage2VideoBlocks | ||
| from .modular_pipeline import LTXModularPipeline | ||
| else: | ||
| import sys | ||
|
|
||
| sys.modules[__name__] = _LazyModule( | ||
| __name__, | ||
| globals()["__file__"], | ||
| _import_structure, | ||
| module_spec=__spec__, | ||
| ) | ||
|
|
||
| for name, value in _dummy_objects.items(): | ||
| setattr(sys.modules[__name__], name, value) |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.