Skip to content

Commit 197f719

Browse files
committed
update the demo description
1 parent d46444a commit 197f719

3 files changed

Lines changed: 32 additions & 14 deletions

File tree

.gitattributes

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
*.mp4 filter=lfs diff=lfs merge=lfs -text

index.html

Lines changed: 31 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -109,13 +109,19 @@ <h1 class="title is-1 publication-title">
109109

110110

111111
<section class="section">
112-
<div class="container" style="margin-top: -2rem;">
113-
<div class="columns is-centered">
114-
<div class="column is-four-fifths has-text-centered">
115-
<div class="content">
116-
<img src="./static/images/html_demo.png" alt="Graphectory demo" style="width: 100%; border-radius: 12px;"/>
117-
<p style="font-size: 1.05rem; margin-top: 1rem;">
118-
Interactive visualization of Graphectory for process-centric analysis of agent trajectories.
112+
<div class="container is-max-desktop">
113+
<div class="columns is-centered has-text-centered">
114+
<div class="column is-four-fifths">
115+
<h2 class="title is-3">Abstract</h2>
116+
<div class="content has-text-justified" style="font-size: 1.12rem;">
117+
<p>
118+
Agentic systems are modern software systems: they consist of orchestrated modules, expose interfaces, and are deployed in software pipelines. Unlike conventional programs, their execution trajectories are inherently stochastic and adaptive to the problems they solve. Evaluation of such systems is often outcome-centric, focusing only on whether the final task succeeds or fails. This narrow view overlooks how agents reason, plan, act, and revise their strategies during execution.
119+
</p>
120+
<p>
121+
We introduce <b>Graphectory</b>, a graph-based representation that systematically encodes the temporal and semantic relations in agent trajectories, enabling process-centric metrics and analyses of workflow quality. Using Graphectory, we analyze 4,000 trajectories from two leading software engineering agents, <b>SWE-agent</b> and <b>OpenHands</b>, paired with four backbone large language models on SWE-bench Verified.
122+
</p>
123+
<p>
124+
Our fully automated analyses reveal that stronger models and richer prompts lead to more complex yet more coherent workflows, while unsuccessful trajectories tend to exhibit chaotic, repetitive, or backtracking behaviors. We further develop a real-time monitoring framework that constructs and analyzes <b>Graphectory</b> and <b>Langutory</b> online to detect process-level issues, notify the agent with diagnostic feedback, and roll back execution when appropriate. Experiments show that online monitoring with intervention improves resolution rates by 6.9%–23.5% on problematic instances while significantly shortening trajectories with near-zero overhead.
119125
</p>
120126
</div>
121127
</div>
@@ -126,26 +132,37 @@ <h1 class="title is-1 publication-title">
126132

127133
<section class="section">
128134
<div class="container is-max-desktop">
129-
<div class="columns is-centered has-text-centered">
135+
<div class="columns is-centered">
130136
<div class="column is-four-fifths">
131-
<h2 class="title is-3">Abstract</h2>
132-
<div class="content has-text-justified" style="font-size: 1.12rem;">
137+
138+
<h2 class="title is-3 has-text-centered">Interactive Demo</h2>
139+
140+
<div class="content has-text-justified" style="font-size: 1.12rem; margin-bottom: 1.5rem;">
133141
<p>
134-
Agentic systems are modern software systems: they consist of orchestrated modules, expose interfaces, and are deployed in software pipelines. Unlike conventional programs, their execution trajectories are inherently stochastic and adaptive to the problems they solve. Evaluation of such systems is often outcome-centric, focusing only on whether the final task succeeds or fails. This narrow view overlooks how agents reason, plan, act, and revise their strategies during execution.
142+
<b>Graphectory</b> provides interactive visualization and process-centric analysis of agent trajectories, enabling users to inspect how software engineering agents reason, explore, patch, and validate over time.
135143
</p>
136144
<p>
137-
We introduce <b>Graphectory</b>, a graph-based representation that systematically encodes the temporal and semantic relations in agent trajectories, enabling process-centric metrics and analyses of workflow quality. Using Graphectory, we analyze 4,000 trajectories from two leading software engineering agents, <b>SWE-agent</b> and <b>OpenHands</b>, paired with four backbone large language models on SWE-bench Verified.
145+
Our current implementation supports trajectories from <b>SWE-agent</b>, <b>OpenHands</b>, and <b>mini-swe-agent</b>. The framework is designed to be extensible, allowing users to adapt it with minimal effort to other agentic systems.
138146
</p>
147+
</div>
148+
149+
<div class="has-text-centered">
150+
<img src="./static/images/html_demo.png"
151+
alt="Interactive visualization of Graphectory"
152+
style="width: 100%; border-radius: 12px;" />
153+
</div>
154+
155+
<div class="content has-text-centered" style="margin-top: 1rem; font-size: 1.02rem;">
139156
<p>
140-
Our fully automated analyses reveal that stronger models and richer prompts lead to more complex yet more coherent workflows, while unsuccessful trajectories tend to exhibit chaotic, repetitive, or backtracking behaviors. We further develop a real-time monitoring framework that constructs and analyzes <b>Graphectory</b> and <b>Langutory</b> online to detect process-level issues, notify the agent with diagnostic feedback, and roll back execution when appropriate. Experiments show that online monitoring with intervention improves resolution rates by 6.9%–23.5% on problematic instances while significantly shortening trajectories with near-zero overhead.
157+
Interactive visualization of Graphectory for trajectory inspection and process-centric analysis.
141158
</p>
142159
</div>
160+
143161
</div>
144162
</div>
145163
</div>
146164
</section>
147165

148-
149166
<section class="section" id="BibTeX">
150167
<div class="container is-max-desktop content">
151168
<h2 class="title is-3 has-text-centered">BibTeX</h2>

static/videos/intro.mp4

-54.3 MB
Binary file not shown.

0 commit comments

Comments
 (0)