You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- Update v0.3.55 to focus specifically on Wan2.2 S2V features
- Simplify model descriptions to reflect actual functionality
- Remove redundant marketing language
- Clarify technical details for better user understanding
- Streamline template and API descriptions
- Apply same improvements to both English and Chinese versions
**Sound-to-Video Workflow Enhancements & Model Support Expansion**
9
+
**Wan2.2 S2V Workflow Enhancements & Model Support Expansion**
10
10
11
-
This release focuses on improving audio-visual workflow capabilities and expanding model support, particularly for sound-to-video generation and the latest Wan2.2 5B models:
11
+
This release focuses on Wan2.2 S2V related video workflow capabilities and model support expansion:
12
12
13
-
**Sound-to-Video Workflow Control**
14
-
-**WanSoundImageToVideoExtend Node**: New manual video extension node for sound-to-video workflows, giving creators precise control over generated video length and timing. This enables fine-tuned control over how audio content translates to video sequences.
13
+
**Wan2.2 S2V Workflow Control**
14
+
-**WanSoundImageToVideoExtend Node**: New manual video extension node for audio-driven video workflows, giving creators precise control over generated video length and timing. This enables fine-tuned control over how audio content translates to video sequences.
15
15
-**Audio-Video Synchronization**: Fixed critical issue where extending video past audio length caused workflow failures, ensuring reliable sound-to-video generation regardless of audio duration.
16
16
-**Automatic Audio Trimming**: Video saves now automatically trim audio to match video length, eliminating audio-video sync issues in final output files.
17
17
18
18
**Advanced Latent Processing**
19
-
-**LatentCut Node**: New node for cutting latents at precise points, enabling more granular control over latent space manipulation in complex generation workflows. This is particularly useful for batch processing and temporal video workflows.
19
+
-**LatentCut Node**: New node for cutting latents at precise points, enabling more granular control over latent space manipulation in complex generation workflows. This is particularly useful for batch processing and temporal video workflows, such as removing specific frames from videos.
20
20
21
21
**Wan2.2 5B Model Integration**
22
-
-**Fun Control Model Support**: Added support for Wan2.2 5B fun control model, expanding creative control options for video generation with enhanced parameter manipulation.
23
-
-**Fun Inpaint Model Support**: Integrated Wan2.2 5B fun inpaint model, providing advanced inpainting capabilities for video workflows with improved quality and consistency.
22
+
-**Fun Control Model Support**: Added support for Wan2.2 5B fun control model.
23
+
-**Fun Inpaint Model Support**: Integrated Wan2.2 5B fun inpaint model.
24
24
25
-
**Template System Updates**
26
-
-**Template v0.1.70**: Updated template system with latest model integrations and workflow examples, ensuring users have access to optimized setups for new features.
25
+
**Workflow Templates**
26
+
-**Template v0.1.70**: Added initial version of Wan2.2 S2V workflows
27
27
28
-
These improvements enhance ComfyUI's capabilities for audio-visual content creation, providing more reliable sound-to-video workflows and additional creative control through the latest Wan2.2 model series.
29
28
30
29
</Update>
31
30
@@ -36,11 +35,10 @@ These improvements enhance ComfyUI's capabilities for audio-visual content creat
36
35
This focused update improves the core node model patching system that underpins ComfyUI's flexible architecture:
37
36
38
37
**Core Infrastructure Enhancement**
39
-
-**Node Model Patch Updates**: Enhanced nodes_model_patch.py with improvements to the underlying model patching mechanism that enables ComfyUI's dynamic node system and model loading capabilities
38
+
-**Node Model Patch Updates**: Enhanced nodes_model_patch.py with improvements to the underlying model patching mechanism, making ComfyUI extensions for Qwen-Image ControlNet easier
40
39
41
40
**Workflow Benefits**
42
41
-**Enhanced Stability**: Core model patching improvements contribute to more reliable node execution and model handling across different workflow configurations
43
-
-**Foundation Update**: These backend improvements lay groundwork for better compatibility with future model architectures and node implementations
44
42
45
43
</Update>
46
44
@@ -52,11 +50,11 @@ This release adds ComfyUI audio processing capabilities and includes performance
52
50
53
51
**Audio Processing Updates**
54
52
-**Wav2vec2 Audio Encoder**: Added native wav2vec2 implementation as an audio encoder model, enabling audio-to-embedding workflows for multimodal applications
55
-
-**Audio Encoders Directory**: Introduced dedicated models/audio_encoders directory structure for organized audio model management
53
+
-**Audio Encoders Directory**: Added models/audio_encoders directory, which is the audio encoder directory for Wan2.2 S2V
56
54
-**AudioEncoderOutput V3 Support**: Made AudioEncoderOutput compatible with V3 node schema, ensuring seamless integration with modern workflow architectures
57
55
58
56
**Google Gemini API Integration**
59
-
-**Gemini Image API Node**: New Google Gemini Image API node by @Kosinkadink provides direct integration with Google's vision AI capabilities, expanding cloud-based image analysis options for workflows
57
+
-**Gemini Image API Node**: Added new Google Gemini Image API node, the "nano-Nano-banana" image editing model API with high consistency
-**WAN 2.2 S2V Model Support**: Work-in-progress implementation of WAN 2.2 Sound-to-Video model with optimized memory usage and performance
@@ -74,10 +72,9 @@ This release adds ComfyUI audio processing capabilities and includes performance
74
72
-**Flux Memory Optimization**: Adjusted Flux model memory usage factors for better resource utilization
75
73
76
74
**Infrastructure & Reliability**
77
-
-**Template Updates**: Updated to versions 0.1.66 and 0.1.68 with latest workflow templates and improvements
75
+
-**Template Updates**: Updated to versions 0.1.66 and 0.1.68
78
76
-**Documentation Cleanup**: Removed incompletely implemented models from readme to avoid user confusion
79
77
80
-
This release particularly benefits creators working with multimodal AI workflows combining audio, image, and video generation, while providing essential stability improvements for all users.
0 commit comments