Skip to content

Commit 0865181

Browse files
committed
docs: update README to reflect native LiteRT deployment for all detection skills
- Remove Docker references from Coral TPU and OpenVINO table entries - Update mermaid diagram to show all 3 detection skills as native - Show Coral TPU using ai-edge-litert + libedgetpu delegate - Show OpenVINO using OpenVINO SDK with NCS2/iGPU/CPU targets - Replace 'docker build' with 'system packages' in LLM install step
1 parent 91c6c42 commit 0865181

1 file changed

Lines changed: 23 additions & 20 deletions

File tree

README.md

Lines changed: 23 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -58,8 +58,8 @@ Each skill is a self-contained module with its own model, parameters, and [commu
5858
| Category | Skill | What It Does | Status |
5959
|----------|-------|--------------|:------:|
6060
| **Detection** | [`yolo-detection-2026`](skills/detection/yolo-detection-2026/) | Real-time 80+ class detection — auto-accelerated via TensorRT / CoreML / OpenVINO / ONNX ||
61-
| | [`yolo-detection-2026-coral-tpu`](skills/detection/yolo-detection-2026-coral-tpu/) | Google Coral Edge TPU — ~4ms inference via USB accelerator ([Docker-based](#detection--segmentation-skills)) | 🧪 |
62-
| | [`yolo-detection-2026-openvino`](skills/detection/yolo-detection-2026-openvino/) | Intel NCS2 USB / Intel GPU / CPU — multi-device via OpenVINO ([Docker-based](#detection--segmentation-skills)) | 🧪 |
61+
| | [`yolo-detection-2026-coral-tpu`](skills/detection/yolo-detection-2026-coral-tpu/) | Google Coral Edge TPU — ~4ms inference via USB accelerator ([LiteRT](#detection--segmentation-skills)) | 🧪 |
62+
| | [`yolo-detection-2026-openvino`](skills/detection/yolo-detection-2026-openvino/) | Intel NCS2 USB / Intel GPU / CPU — multi-device via OpenVINO ([architecture](#detection--segmentation-skills)) | 🧪 |
6363
| **Analysis** | [`home-security-benchmark`](skills/analysis/home-security-benchmark/) | [143-test evaluation suite](#-homesec-bench--how-secure-is-your-local-ai) for LLM & VLM security performance ||
6464
| **Privacy** | [`depth-estimation`](skills/transformation/depth-estimation/) | [Real-time depth-map privacy transform](#-privacy--depth-map-anonymization) — anonymize camera feeds while preserving activity ||
6565
| **Segmentation** | [`sam2-segmentation`](skills/segmentation/sam2-segmentation/) | Interactive click-to-segment with Segment Anything 2 — pixel-perfect masks, point/box prompts, video tracking ||
@@ -74,38 +74,41 @@ Each skill is a self-contained module with its own model, parameters, and [commu
7474
7575
### Detection & Segmentation Skills
7676

77-
Detection and segmentation skills process visual data from camera feeds — detecting objects, segmenting regions, or analyzing scenes. All skills use the same **JSONL stdin/stdout protocol**: Aegis writes a frame to a shared volume, sends a `frame` event on stdin, and reads `detections` from stdout. This means every detection skill — whether running natively or inside Docker — is interchangeable from Aegis's perspective.
77+
Detection and segmentation skills process visual data from camera feeds — detecting objects, segmenting regions, or analyzing scenes. All skills use the same **JSONL stdin/stdout protocol**: Aegis writes a frame to a shared volume, sends a `frame` event on stdin, and reads `detections` from stdout. Every detection skill is interchangeable from Aegis's perspective.
7878

7979
```mermaid
8080
graph TB
8181
CAM["📷 Camera Feed"] --> GOV["Frame Governor (5 FPS)"]
8282
GOV --> |"frame.jpg → shared volume"| PROTO["JSONL stdin/stdout Protocol"]
8383
84-
PROTO --> NATIVE["🖥️ Native: yolo-detection-2026"]
85-
PROTO --> DOCKER["🐳 Docker: Coral TPU / OpenVINO"]
84+
PROTO --> YOLO["yolo-detection-2026"]
85+
PROTO --> CORAL["yolo-detection-2026-coral-tpu"]
86+
PROTO --> OV["yolo-detection-2026-openvino"]
8687
87-
subgraph Native["Native Skill (runs on host)"]
88-
NATIVE --> ENV["env_config.py auto-detect"]
88+
subgraph Native["All skills run natively on host"]
89+
YOLO --> ENV["env_config.py auto-detect"]
8990
ENV --> TRT["NVIDIA → TensorRT"]
9091
ENV --> CML["Apple Silicon → CoreML"]
91-
ENV --> OV["Intel → OpenVINO IR"]
92+
ENV --> OVIR["Intel → OpenVINO IR"]
9293
ENV --> ONNX["AMD / CPU → ONNX"]
93-
end
9494
95-
subgraph Container["Docker Container"]
96-
DOCKER --> CORAL["Coral TPU → pycoral"]
97-
DOCKER --> OVIR["OpenVINO → Ultralytics OV"]
98-
DOCKER --> CPU["CPU fallback"]
99-
CORAL -.-> USB["USB/IP passthrough"]
100-
OVIR -.-> DRI["/dev/dri · /dev/bus/usb"]
95+
CORAL --> LITERT["ai-edge-litert + libedgetpu"]
96+
LITERT --> TPU["Coral USB → Edge TPU delegate"]
97+
LITERT --> CPU1["No TPU → CPU fallback"]
98+
99+
OV --> OVSDK["OpenVINO SDK"]
100+
OVSDK --> NCS2["Intel NCS2 USB"]
101+
OVSDK --> IGPU["Intel iGPU / Arc"]
102+
OVSDK --> CPU2["CPU fallback"]
101103
end
102104
103-
NATIVE --> |"stdout: detections"| AEGIS["Aegis IPC → Live Overlay + Alerts"]
104-
DOCKER --> |"stdout: detections"| AEGIS
105+
YOLO --> |"stdout: detections"| AEGIS["Aegis IPC → Live Overlay + Alerts"]
106+
CORAL --> |"stdout: detections"| AEGIS
107+
OV --> |"stdout: detections"| AEGIS
105108
```
106109

107-
- **Native skills** run directly on the host — [`env_config.py`](skills/lib/env_config.py) auto-detects the GPU and converts models to the fastest format (TensorRT, CoreML, OpenVINO IR, ONNX)
108-
- **Docker skills** wrap hardware-specific runtimes in a container — cross-platform USB/device access without native driver installation
110+
- **All skills run natively** — each creates a Python venv, installs its own dependencies, and accesses hardware directly (no Docker required)
111+
- **Coral TPU** uses [ai-edge-litert](https://pypi.org/project/ai-edge-litert/) (LiteRT) with the `libedgetpu` delegate — supports Python 3.9–3.13 on Linux, macOS, and Windows
109112
- **Same output** — Aegis sees identical JSONL from all skills, so detection overlays, alerts, and forensic analysis work with any backend
110113

111114
#### LLM-Assisted Skill Installation
@@ -114,7 +117,7 @@ Skills are installed by an **autonomous LLM deployment agent** — not by brittl
114117

115118
1. **Probe** — reads `SKILL.md`, `requirements.txt`, and `package.json` to understand what the skill needs
116119
2. **Detect hardware** — checks for NVIDIA (CUDA), AMD (ROCm), Apple Silicon (MPS), Intel (OpenVINO), or CPU-only
117-
3. **Install** — runs the right commands (`pip install`, `npm install`, `docker build`) with the correct backend-specific dependencies
120+
3. **Install** — runs the right commands (`pip install`, `npm install`, system packages) with the correct backend-specific dependencies
118121
4. **Verify** — runs a smoke test to confirm the skill loads before marking it complete
119122
5. **Determine launch command** — figures out the exact `run_command` to start the skill and saves it to the registry
120123

0 commit comments

Comments
 (0)