You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
site: add a supporting block-trio to Vision, Design, and Experiments
Vision: the discovery loop (Express/Deploy/Iterate). Design: the three
abstraction layers (vFlow/vTensor/Serving System). Experiments: the three
research axes with headline metrics.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@@ -206,6 +218,11 @@ <h2 class="sec-title reveal">Agents as algorithm designers</h2>
206
218
<figcaption>Each point is one sparse-attention algorithm generated or optimized by AI agents using Vortex (Qwen3-1.7B, AIME, NVIDIA H200).</figcaption>
207
219
</figure>
208
220
</div>
221
+
<divclass="trio">
222
+
<divclass="blk reveal"><spanclass="idx">01</span><h3>Express</h3><p>An agent writes the sparse-attention idea in a few lines of high-level Python ops — scoring, reductions, top-<em>k</em>.</p></div>
223
+
<divclass="blk reveal"><spanclass="idx">02</span><h3>Deploy</h3><p>Vortex JIT-compiles it into fused kernels that run inside a real LLM serving stack — no model-code changes.</p></div>
224
+
<divclass="blk reveal"><spanclass="idx">03</span><h3>Iterate</h3><p>The agent reads measured throughput and accuracy, then refines — autonomous discovery in a closed loop.</p></div>
@@ -228,13 +245,23 @@ <h2 class="sec-title reveal">A frontend for ideas, a backend for serving</h2>
228
245
<divclass="feature reveal"><divclass="ico">⚡</div><h3>High Performance</h3><p>Fused Triton/CUDA kernels with FlashInfer, CUDA Graph, and radix attention.</p></div>
229
246
<divclass="feature reveal"><divclass="ico">🤖</div><h3>Agent Native</h3><p>Agents generate, deploy, and refine algorithms end-to-end — discovery in a loop.</p></div>
230
247
</div>
248
+
<divclass="trio">
249
+
<divclass="blk reveal"><spanclass="idx">▣</span><h3><code>vFlow</code></h3><p>A Python-embedded frontend language. Declare what to attend to; the framework handles batching, caching, and fusion.</p></div>
250
+
<divclass="blk reveal"><spanclass="idx">▦</span><h3><code>vTensor</code></h3><p>A page-centric tensor abstraction where the page is the unit of sparsity — uniform across MHA and MLA models.</p></div>
251
+
<divclass="blk reveal"><spanclass="idx">▤</span><h3>Serving System</h3><p>A backend tightly integrated with SGLang: FlashInfer kernels, CUDA Graph, and radix-cache decoding.</p></div>
<h2class="sec-title reveal">Discovery, scale, and emerging architectures</h2>
237
259
<pclass="lead reveal">Vortex accelerates sparse-attention research along three axes: <strong>autonomous discovery</strong>, reach into <strong>emerging architectures and very large models</strong>, and use as a <strong>research instrument</strong> for understanding where the routing signal lives.</p>
260
+
<divclass="trio">
261
+
<divclass="blk reveal"><spanclass="idx">①</span><h3>Autonomous discovery</h3><p>Agents generate and refine diverse algorithms that are consistently Pareto-efficient.</p><spanclass="metric">up to 3.46× throughput</span></div>
262
+
<divclass="blk reveal"><spanclass="idx">②</span><h3>Scale & architectures</h3><p>Sparse attention extended to MLA models and very large models that are otherwise hard to experiment with.</p><spanclass="metric">4.7× GLM-4.7 · 1.37× 229B</span></div>
263
+
<divclass="blk reveal"><spanclass="idx">③</span><h3>Research instrument</h3><p>A lens on sparse attention itself — pinpointing where the routing signal lives.</p><spanclass="metric">interpretability</span></div>
264
+
</div>
238
265
<divclass="gallery">
239
266
<articleclass="exp reveal">
240
267
<divclass="imgwrap"><imgsrc="assets/fig11_iter_c.png" alt="Accuracy–throughput frontier across 23 autonomous iterations" /></div>
0 commit comments