MultiGPU Work Units For Accelerated Sampling#7063

Open

Kosinkadink wants to merge 131 commits intomasterfrom

worksplit-multigpu

Commits on Dec 29, 2024

Add 'sigmas' to transformer_options so that downstream code can know about the full scope of current sampling run, fix Hook Keyframes' guarantee_steps=1 inconsistent behavior with sampling split ac…
Kosinkadink
committed

Commits on Dec 30, 2024

Merge branch 'master' into hooks_part2
Kosinkadink
committed

Commits on Jan 4, 2025

Merge branch 'master' into hooks_part2
Kosinkadink
committed
Cleaned up hooks.py, refactored Hook.should_register and add_hook_patches to use target_dict instead of target so that more information can be provided about the current execution environment if ne…
Kosinkadink
committed
Refactor WrapperHook into TransformerOptionsHook, as there is no need to separate out Wrappers/Callbacks/Patches into different hook types (all affect transformer_options)
Kosinkadink
committed
Refactored HookGroup to also store a dictionary of hooks separated by hook_type, modified necessary code to no longer need to manually separate out hooks by hook_type
Kosinkadink
committed

Commits on Jan 5, 2025

Commits on Jan 6, 2025

Commits on Jan 8, 2025

Commits on Jan 11, 2025

Commits on Jan 12, 2025

Merge branch 'master' into multigpu_support
Kosinkadink
committed

Commits on Jan 16, 2025

Merge branch 'master' into multigpu_support
Kosinkadink
committed

Commits on Jan 17, 2025

Commits on Jan 23, 2025

Added unload_model_and_clones to model_management.py to allow unloading only relevant models
Kosinkadink
committed

Commits on Jan 24, 2025

Commits on Jan 25, 2025

Fix multigpu ControlBase get_models and cleanup calls to avoid multiple calls of functions on multigpu_clones versions of controlnets
Kosinkadink
committed

Commits on Jan 26, 2025

Commits on Jan 27, 2025

Extracted multigpu core code into multigpu.py, added load_balance_devices to get subdivision of work based on available devices and splittable work item count, added MultiGPU Options nodes to set r…
Kosinkadink
committed

Commits on Jan 28, 2025

Merge remote-tracking branch 'origin/master' into multigpu_support
Kosinkadink
committed

Commits on Jan 29, 2025

Carry over change from _calc_cond_batch into _calc_cond_batch_multigpu
Kosinkadink
committed

Commits on Feb 2, 2025

Merge branch 'master' into multigpu_support
Kosinkadink
committed

Commits on Feb 6, 2025

Commits on Feb 7, 2025

Merge branch 'multigpu_support' into worksplit-multigpu
Kosinkadink
committed

Commits on Feb 12, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Feb 18, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Feb 25, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Mar 4, 2025

Commits on Mar 9, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Mar 14, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Mar 15, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Mar 17, 2025

Commits on Mar 19, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Mar 27, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Mar 28, 2025

Commits on Apr 9, 2025

Commits on Apr 16, 2025

Commits on Apr 17, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Apr 18, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Apr 19, 2025

Commits on Apr 23, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on May 13, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on May 21, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jun 1, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jun 17, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jun 24, 2025

Commits on Jul 1, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jul 9, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jul 22, 2025

Merge branch 'master' into worksplit-multigpu-wip
Kosinkadink
committed

Commits on Jul 27, 2025

Merge branch 'master' into worksplit-multigpu-wip
Kosinkadink
committed

Commits on Jul 28, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jul 29, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jul 30, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Jul 31, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 1, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 5, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 8, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 11, 2025

Commits on Aug 13, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 14, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 15, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 17, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 18, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 19, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Aug 30, 2025

Merge remote-tracking branch 'origin/master' into worksplit-multigpu
Kosinkadink
committed

Commits on Sep 12, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Sep 18, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Sep 25, 2025

Merge branch 'master' into worksplit-multigpu
Kosinkadink
committed

Commits on Oct 14, 2025

Commits on Oct 16, 2025

Commits on Feb 17, 2026

Commits on Mar 18, 2026

Merge origin/master into worksplit-multigpu

Kosinkadink
and
ampcode-com
committed

Commits on Mar 30, 2026

Commits on Apr 8, 2026

Commits on Apr 9, 2026

Simplify multigpu dispatch: run all devices on pool threads (#13340)
Kosinkadink
authored

Commits on Apr 16, 2026

Minor updates for worksplit_gpu with comfy-aimdo (#13419)
rattus128
authored

Commits on Apr 20, 2026

Commits on Apr 24, 2026