feat: mac computer use (#1557)

* docs: add mac computer use spec

* docs: sync provider tables

* fix: rtk status (#1541)

* fix(rtk): simplify health check

* fix(knowledge): use config ipc

* fix(models): persist db model status

* fix: harden MCP env and knowledge delete

* fix: clean knowledge presenter cleanup paths

* refactor: enhance transition effects and performance across message components (#1542)

- Updated transition classes in MessageActionButtons.vue for smoother animations.
- Refactored MessageBlockContent.vue to optimize artifact snapshot handling with computed properties.
- Improved transition effects in MessageBlockToolCall.vue for better user experience.
- Added a mention icon map in MessageContent.vue to streamline icon retrieval.
- Enhanced MessageItemUser.vue with a new line counting function for better text handling.
- Optimized MessageToolbar.vue for consistent transition effects on button interactions.
- Refactored BrowserPanel.vue to simplify state management for synced bounds.
- Improved ChatSidePanel.vue with better resizing and visibility handling.
- Updated ChatPage.vue to enhance chat search highlight scheduling.
- Cleaned up ChatTabView.vue by removing legacy collapsed new chat button functionality.
- Enhanced tests in ChatTabView.test.ts and WindowSideBar.test.ts for improved coverage and accuracy.

* chore: update markstream-vue to 0.0.13 (#1544)

* fix: preserve interleaved reasoning (#1543)

* chore(release): prepare v1.0.4-beta.2

* fix(ipc): allow attachment date metadata (#1547)

* chore(release): prepare v1.0.4-beta.3

* feat: add mac computer use helper

* feat: enhance computer use guidance

* chore: bump acp registry versions

* fix: import mac signing identity for helper

* build(cua): vendor CUA driver source

* fix(cua): prefer element index click mode

* fix(cua): route zoom clicks by coordinates

* docs(cua): prefer visual fallback for sparse UI

* feat: update vendored cua driver

* fix(computer-use): improve error handling and testability

* docs(cua): add runtime plugin spec

* feat(plugin): add CUA runtime plugin

* feat: migrate computer use to plugin

* fix: surface plugin tools and permissions

* fix(plugin): use MCP-only CUA flow

* ci(plugin): release CUA dcplugin assets

* fix(plugin): hide CUA on unsupported OS

* feat(plugin): bundle official CUA plugin

* fix: harden plugin startup and CUA telemetry

* chore: update CUA driver vendor

* fix(build): sign CUA plugin helper

* fix: improve CUA window scoped vision fallback

* fix(cua): align pixel clicks with upstream

---------

Co-authored-by: yyhhyyyyyy <yyhhyyyyyy8@gmail.com>
Co-authored-by: xiaomo <wegi866@gmail.com>

Author: 3 people

.github/workflows/build.yml

@@ -188,6 +188,7 @@ jobs:
       - name: Build Mac
         run: |
           pnpm run build
+          pnpm run plugin:cua:bundle:mac:${{ matrix.arch }}
           pnpm exec electron-builder --mac --${{ matrix.arch }} --publish=never
         env:
           CSC_LINK: ${{ secrets.DEEPCHAT_CSC_LINK }}
@@ -202,6 +203,20 @@ jobs:
           NODE_OPTIONS: '--max-old-space-size=4096'
           VITE_PROVIDER_DB_URL: ${{ secrets.CDN_PROVIDER_DB_URL }}
 
+      - name: Verify bundled CUA plugin
+        shell: bash
+        env:
+          TARGET_ARCH: ${{ matrix.arch }}
+        run: |
+          VERSION="$(node -p "require('./package.json').version")"
+          APP_DIR="dist/mac/DeepChat.app"
+          if [ "$TARGET_ARCH" = "arm64" ]; then
+            APP_DIR="dist/mac-arm64/DeepChat.app"
+          fi
+          PLUGIN="${APP_DIR}/Contents/Resources/app.asar.unpacked/plugins/deepchat-plugin-cua-${VERSION}-darwin-${TARGET_ARCH}.dcplugin"
+          test -f "$PLUGIN"
+          ls -lh "$PLUGIN"
+
       - name: Upload artifacts
         uses: actions/upload-artifact@v6
         with:

.github/workflows/release.yml

@@ -288,6 +288,7 @@ jobs:
       - name: Build Mac
         run: |
           pnpm run build
+          pnpm run plugin:cua:bundle:mac:${{ matrix.arch }}
           pnpm exec electron-builder --mac --${{ matrix.arch }} --publish=never
         env:
           CSC_LINK: ${{ secrets.DEEPCHAT_CSC_LINK }}
@@ -303,6 +304,20 @@ jobs:
           NODE_OPTIONS: '--max-old-space-size=4096'
           VITE_PROVIDER_DB_URL: ${{ secrets.CDN_PROVIDER_DB_URL }}
 
+      - name: Verify bundled CUA plugin
+        shell: bash
+        env:
+          TARGET_ARCH: ${{ matrix.arch }}
+        run: |
+          VERSION="$(node -p "require('./package.json').version")"
+          APP_DIR="dist/mac/DeepChat.app"
+          if [ "$TARGET_ARCH" = "arm64" ]; then
+            APP_DIR="dist/mac-arm64/DeepChat.app"
+          fi
+          PLUGIN="${APP_DIR}/Contents/Resources/app.asar.unpacked/plugins/deepchat-plugin-cua-${VERSION}-darwin-${TARGET_ARCH}.dcplugin"
+          test -f "$PLUGIN"
+          ls -lh "$PLUGIN"
+
       - name: Upload artifacts
         uses: actions/upload-artifact@v6
         with:

.gitignore

@@ -14,7 +14,9 @@ build/macarm.json
 build/macx64.json
 build/winarm.json
 build/winx64.json
+build/bundled-plugins/
 runtime/**/*
+plugins/*/runtime/**/*
 .eslintcache
 .env
 .env.local

docs/README.md

@@ -35,6 +35,7 @@ Renderer
 | [architecture/session-management.md](./architecture/session-management.md) | 新会话管理与 legacy 数据平面边界 |
 | [guides/code-navigation.md](./guides/code-navigation.md) | 当前代码导航入口 |
 | [guides/getting-started.md](./guides/getting-started.md) | 新开发者快速上手 |
+| [guides/plugin-packaging.md](./guides/plugin-packaging.md) | `.dcplugin` 打包、内置分发和 release 规则 |
 | [architecture/baselines/dependency-report.md](./architecture/baselines/dependency-report.md) | 当前依赖与耦合基线 |
 | [architecture/baselines/main-kernel-boundary-baseline.md](./architecture/baselines/main-kernel-boundary-baseline.md) | main kernel refactor 当前阶段的边界指标与 hot path 快照 |
 | [architecture/baselines/main-kernel-bridge-register.md](./architecture/baselines/main-kernel-bridge-register.md) | main kernel refactor 的临时 bridge 登记表 |
@@ -112,6 +113,7 @@ docs/
 ├── guides/
 │   ├── getting-started.md
 │   ├── code-navigation.md
+│   ├── plugin-packaging.md
 │   └── debugging.md
 ├── specs/
 │   ├── agent-cleanup/
@@ -151,4 +153,3 @@ docs/
    - 工具与权限： [architecture/tool-system.md](./architecture/tool-system.md)
    - 会话与兼容边界： [architecture/session-management.md](./architecture/session-management.md)
 4. 如果需要对照旧实现，再去看 `archives/` 历史文档，不要依赖已经移除的历史源码快照。
-

docs/guides/plugin-packaging.md

@@ -0,0 +1,119 @@
+# DeepChat Plugin Packaging
+
+This guide documents `.dcplugin` packaging for official DeepChat plugins bundled with DeepChat
+release packages.
+
+## Package Format
+
+A `.dcplugin` file is a zip archive built from one plugin directory.
+
+Required files:
+
+- `plugin.json`: hydrated manifest used by the installer.
+- `checksums.json`: SHA-256 checksums for packaged files.
+- every file declared by manifest skills and settings contributions.
+- runtime payloads required by the target platform and architecture.
+
+The packager excludes development-only sources such as `vendor/`, `build/`, `node_modules/`,
+`.build/`, `.DS_Store`, and symlinks.
+
+Official packages keep DeepChat release asset URLs in their manifest metadata:
+
+```text
+https://github.com/ThinkInAIXYZ/deepchat/releases/download/v<version>/<asset-name>.dcplugin
+```
+
+## CUA Plugin Artifacts
+
+The CUA plugin ships one macOS helper app per CPU architecture. The bundled package filename
+includes both platform and architecture:
+
+```text
+deepchat-plugin-cua-<version>-darwin-arm64.dcplugin
+deepchat-plugin-cua-<version>-darwin-x64.dcplugin
+```
+
+The manifest inside each package keeps the official DeepChat release-download namespace for trust
+metadata. Runtime detection inside the package uses the same architecture-specific plugin path:
+
+```text
+plugin:runtime/darwin/<arch>/DeepChat Computer Use.app/Contents/MacOS/cua-driver
+```
+
+Architecture mapping:
+
+| DeepChat arch | Swift arch | Runtime directory |
+| --- | --- | --- |
+| `arm64` | `arm64` | `runtime/darwin/arm64/` |
+| `x64` | `x86_64` | `runtime/darwin/x64/` |
+
+Each `.dcplugin` contains only the runtime directory for its target architecture.
+
+## Local Commands
+
+Validate the package metadata for the current host architecture:
+
+```bash
+pnpm run plugin:cua:validate
+```
+
+Build and package the current host architecture:
+
+```bash
+pnpm run plugin:cua:package
+```
+
+Build and package explicit macOS architectures:
+
+```bash
+pnpm run plugin:cua:package:mac:arm64
+pnpm run plugin:cua:package:mac:x64
+```
+
+Build the package that will be embedded into the macOS app:
+
+```bash
+pnpm run plugin:cua:bundle:mac:arm64
+pnpm run plugin:cua:bundle:mac:x64
+```
+
+Validate explicit macOS architectures after their helper runtimes have been staged:
+
+```bash
+pnpm run plugin:cua:validate:mac:arm64
+pnpm run plugin:cua:validate:mac:x64
+```
+
+Standalone packages are written to:
+
+```text
+dist/plugins/
+```
+
+Bundled packages are written to:
+
+```text
+build/bundled-plugins/
+```
+
+## CI And Release
+
+The macOS build matrix in `.github/workflows/build.yml` builds the matching CUA plugin bundle before
+running `electron-builder`. Electron Builder embeds it into:
+
+```text
+DeepChat.app/Contents/Resources/app.asar.unpacked/plugins/
+```
+
+Each matrix job verifies the expected bundled `.dcplugin` exists inside the app before uploading
+artifacts.
+
+The release workflow repeats the same bundled package step. The final release uploads app artifacts
+only; `.dcplugin` files are not published as separate GitHub Release assets.
+
+Expected embedded files:
+
+```text
+app.asar.unpacked/plugins/deepchat-plugin-cua-<version>-darwin-x64.dcplugin
+app.asar.unpacked/plugins/deepchat-plugin-cua-<version>-darwin-arm64.dcplugin
+```

docs/specs/cua-runtime-plugin/non-macos-handoff.md

@@ -0,0 +1,52 @@
+# Non-macOS Handoff Notes
+
+This implementation was completed on Windows, so the architecture and TypeScript integration were
+validated locally, while macOS runtime behavior still needs a Mac pass.
+
+## Implemented
+
+- Official-source-only plugin installation path with GitHub Release download and local
+  `.dcplugin` selection.
+- Generic plugin resources for runtimes, MCP servers, skills, settings contributions, and tool
+  policies.
+- Plugin-owned MCP registration with `ownerPluginId`.
+- Plugin-owned skill contribution support.
+- Isolated plugin settings renderer preload API exposed as `window.deepchatPlugin`.
+- Official `plugins/cua` package with a bundled macOS `DeepChat Computer Use.app` helper runtime.
+- CI/package scripts for architecture-specific
+  `deepchat-plugin-cua-<version>-darwin-<arch>.dcplugin` artifacts.
+- App packaging no longer embeds the CUA helper inside the DeepChat app bundle.
+- App packaging no longer embeds the CUA plugin source; the app and plugin artifacts are built
+  independently.
+
+## Manual Install Flow
+
+1. Build the plugin package for the current Mac:
+   `pnpm run plugin:cua:package`
+   - Apple Silicon explicit package: `pnpm run plugin:cua:package:mac:arm64`
+   - Intel explicit package: `pnpm run plugin:cua:package:mac:x64`
+2. Open Settings > Plugins.
+3. Click Install on `com.deepchat.plugins.cua`.
+   - DeepChat first downloads
+     `https://github.com/ThinkInAIXYZ/deepchat/releases/download/v<app-version>/deepchat-plugin-cua-<app-version>-darwin-<arch>.dcplugin`.
+   - If the asset is missing, DeepChat opens the matching GitHub Release page.
+4. Click Choose `.dcplugin` and select the downloaded package when automatic download is not
+   available.
+5. Enable `com.deepchat.plugins.cua`, then verify runtime status, permission check, MCP
+   registration, skill visibility, and tool policy prompts.
+
+## Requires macOS validation
+
+- `cua-driver --version` output shape.
+- `cua-driver check_permissions` output shape and permission parsing.
+- `cua-driver mcp` startup under DeepChat MCP stdio management.
+- TCC ownership remains with the bundled `DeepChat Computer Use.app` helper inside the installed
+  plugin.
+- Plugin settings window can open the CUA permission guide and refresh status.
+- Signed `.dcplugin` packaging and official source distribution metadata.
+
+## Legacy Demo Code
+
+The prior built-in Computer Use implementation is removed from startup, routes, renderer API,
+settings, helper packaging, vendored source, and tests. The remaining CUA-specific source of truth is
+`plugins/cua`.