You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
feat(depth-estimation): CoreML-first backend on macOS + PyTorch fallback
On macOS, loads CoreML .mlpackage from ~/.aegis-ai/models/feature-extraction/
using coremltools (Neural Engine). Auto-downloads from
apple/coreml-depth-anything-v2-small on HuggingFace if not present.
On other platforms, falls back to PyTorch DepthAnythingV2 + hf_hub_download.
Verified: CoreML inference at 65.7ms/frame (~15 FPS) on Apple Silicon.
- requirements.txt: add coremltools>=8.0 (darwin-only platform marker)
- SKILL.md: v1.2.0, hardware backend table, CoreML variant parameter
@@ -53,12 +60,21 @@ Real-time monocular depth estimation using Depth Anything v2. Transforms camera
53
60
54
61
When used for **privacy mode**, the `depth_only` blend mode fully anonymizes the scene while preserving spatial layout and activity, enabling security monitoring without revealing identities.
55
62
63
+
## Hardware Backends
64
+
65
+
| Platform | Backend | Runtime | Model |
66
+
|----------|---------|---------|-------|
67
+
|**macOS**| CoreML | Apple Neural Engine |`apple/coreml-depth-anything-v2-small` (.mlpackage) |
68
+
| Linux/Windows | PyTorch | CUDA / CPU |`depth-anything/Depth-Anything-V2-Small` (.pth) |
69
+
70
+
On macOS, CoreML runs on the Neural Engine, leaving the GPU free for other tasks. The model is auto-downloaded from HuggingFace and stored at `~/.aegis-ai/models/feature-extraction/`.
71
+
56
72
## What You Get
57
73
58
74
-**Privacy anonymization** — depth-only mode hides all visual identity
59
75
-**Depth overlays** on live camera feeds
60
-
-**Distance estimation** — approximate distance to detected objects
61
76
-**3D scene understanding** — spatial layout of the scene
77
+
-**CoreML acceleration** — Neural Engine on Apple Silicon (3-5x faster than MPS)
62
78
63
79
## Interface: TransformSkillBase
64
80
@@ -88,14 +104,14 @@ class MyPrivacySkill(TransformSkillBase):
0 commit comments