Skip to content

Commit 2622361

Browse files
docs(cli): cover desktop-control driver on the droid-control page (CLI-900) (#1215)
1 parent d2c3116 commit 2622361

1 file changed

Lines changed: 14 additions & 4 deletions

File tree

docs/cli/features/droid-control.mdx

Lines changed: 14 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
title: Droid Control
33
sidebarTitle: Droid Control
44
description: Terminal, browser, and desktop automation. Record demos, verify behavior claims, and run QA flows.
5-
keywords: ['droid-control', 'automation', 'demo', 'verify', 'qa-test', 'terminal', 'browser', 'recording', 'video', 'showcase', 'tuistory', 'remotion', 'tctl', 'plugin']
5+
keywords: ['droid-control', 'automation', 'demo', 'verify', 'qa-test', 'terminal', 'browser', 'desktop', 'desktop-control', 'cua-driver', 'computer-use', 'recording', 'video', 'showcase', 'tuistory', 'remotion', 'tctl', 'plugin']
66
---
77

88
Droid Control lets Droids *operate* software: launch apps, type commands, click buttons, record what happens, and produce polished video evidence of it. Built by Droids, for Droids.
@@ -192,9 +192,9 @@ Every video below was planned, recorded, and rendered entirely by a Droid.
192192

193193
## Automation drivers
194194

195-
Droid Control supports three automation backends. The right one is selected automatically based on what you're targeting.
195+
Droid Control supports four automation backends. The right one is selected automatically based on what you're targeting.
196196

197-
<CardGroup cols={3}>
197+
<CardGroup cols={2}>
198198
<Card title="tuistory" icon="terminal">
199199
**Virtual PTY automation.** Default for terminal work. Playwright-style CLI with asciinema recording and forced truecolor output.
200200
</Card>
@@ -204,6 +204,9 @@ Droid Control supports three automation backends. The right one is selected auto
204204
<Card title="agent-browser" icon="globe">
205205
**Web and Electron apps.** Playwright-backed CLI with Chrome DevTools Protocol support. Navigates pages, fills forms, clicks buttons, captures screenshots.
206206
</Card>
207+
<Card title="desktop-control" icon="desktop">
208+
**Native desktop apps.** Accessibility-tree snapshots, element or pixel actions, and per-window screenshots via [trycua/cua](https://github.com/trycua/cua) `cua-driver` -- all without stealing focus. macOS and Windows are production tier; Linux is pre-release.
209+
</Card>
207210
</CardGroup>
208211

209212
## Video rendering
@@ -241,7 +244,7 @@ Demo and showcase videos are rendered with [Remotion](https://www.remotion.dev/)
241244
The plugin uses a composition architecture with three layers:
242245

243246
- **Orchestrator** -- Routes each request through three independent lookups (target, stage, artifact) to determine which skills to load.
244-
- **10 atom skills** -- Self-contained background knowledge loaded on demand, split into drivers, targets, stages, and polish.
247+
- **11 atom skills** -- Self-contained background knowledge loaded on demand, split into drivers, targets, stages, and polish.
245248
- **3 commands** -- Parse arguments into commitments, then delegate to atoms via hybrid handoffs.
246249

247250
Every workflow flows through **capture → compose → verify**. Commands declare *what* to produce; atoms own *how*. Skills chain through explicit handoffs rather than hardcoded pipelines, so the droid follows the flow naturally.
@@ -268,6 +271,13 @@ Only install what you need for your use case.
268271
agent-browser install # downloads Chromium
269272
```
270273
</Accordion>
274+
<Accordion title="Native desktop apps (desktop-control)">
275+
```bash
276+
curl -fsSL https://raw.githubusercontent.com/trycua/cua/main/libs/cua-driver/scripts/install.sh | bash
277+
cua-driver skills install # upstream skill pack (deep tool reference)
278+
```
279+
Windows installs via PowerShell: `irm https://raw.githubusercontent.com/trycua/cua/main/libs/cua-driver/scripts/install.ps1 | iex`. macOS additionally needs `cua-driver permissions grant` (Accessibility + Screen Recording).
280+
</Accordion>
271281
<Accordion title="Real terminal emulator (true-input)">
272282
| Platform | Required tools |
273283
|----------|----------------|

0 commit comments

Comments
 (0)