Skip to content

Commit 865be92

Browse files
committed
update
1 parent 9573d75 commit 865be92

1 file changed

Lines changed: 3 additions & 1 deletion

File tree

_articles/MagiCompiler.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ layout: post
33
title: "Graph Fusion for DiT Inference: Magi Compiler in LightX2V"
44
author: "LightX2V and SandAI"
55
date: 2026-05-21
6-
tags: [MagiCompiler, torch.compile, NeoPP, QwenImage, Performance]
6+
tags: [MagiCompiler, torch.compile, QwenImage, Performance]
77
---
88

99
In DiT inference for video and image generation, compute-heavy core operators often already have dedicated optimized kernels, yet many small operator chains still lack mature, efficient optimizations—memory traffic and kernel launch overhead remain non-trivial. Hand-written Triton can optimize hot spots in those chains, but each pattern requires separate development and maintenance; using `torch.compile` directly often yields unstable gains or even regressions when subgraph boundaries and dynamic shapes are not handled carefully.
@@ -14,6 +14,8 @@ This post introduces [Magi Compiler](https://github.com/SandAI-org/MagiCompiler)
1414
- **Steady-state speedups on pre-Triton paths**: ~15–20% per-step improvement on NeoPP at steady state; ~20% on Qwen Image with Triton OFF; closes much of the gap to hand-tuned Triton (~93–94%).
1515
- **Multi-resolution serving on the compile path**: within a single process, switching resolutions can reuse compiled subgraphs, avoiding repeated per-shape recompilation that inflates first-step latency.
1616

17+
We thank the **SandAI** team for developing and open-sourcing [Magi Compiler](https://github.com/SandAI-org/MagiCompiler), and for their pioneering integration work in [LightX2V-MagiCompiler](https://github.com/SandAI-org/LightX2V-MagiCompiler)—their compiler design and reference implementation made this LightX2V integration possible.
18+
1719
**Table of contents:**
1820

1921
- [Why DiT Inference Needs Magi Compiler](#why-dit-inference-needs-magi-compiler)

0 commit comments

Comments
 (0)