You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+18-6Lines changed: 18 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,14 +1,26 @@
1
1
VisionProTeleop
2
2
===========
3
3
4
-
> **🎉 UPDATE: Now supporting Low-Latency Video Streaming!** You can now stream back your robot's camera feed back to Vision Pro via webRTC protocol, alongside the original hand tracking data stream.
5
-
No complicated network setting required. Download the app, `pip install avp_stream`, and you're done!
6
4
7
-

5
+
> **🎉 UPDATE: Now supporting Low-Latency Video Streaming!** You can now stream back your robot's camera feed back to Vision Pro via webRTC protocol, alongside the original hand tracking data stream. No complicated network setting required. Download the app, `pip install avp_stream`, and you're done!
Wanna use your new Apple Vision Pro to control your robot? Wanna record how you navigate and manipulate the world?
12
24
13
25
This VisionOS app and python library streams your Head + Wrist + Hand Tracking result via gRPC over a WiFi network, so any robots connected to the same wifi network can subscribe and use. **It can also stream stereo (or mono) camera feeds from your robot, back to the Vision Pro.**
14
26
@@ -42,7 +54,7 @@ After installation, click on the app on Vision Pro and click `Start`. That's it!
42
54
**Tip** Remember the IP address before you click start; you need to specify this IP address to subscribe to the data. Once you click start, the app will immediately enter into pass-through mode. Click on the digital crown to stop streaming.
43
55
44
56
45
-
### Step 3. Receive the stream from anywhere
57
+
### Step 3. Receive the hand tracking data from anywhere
46
58
47
59
The following python package allows you to receive the data stream from any device that's connected to the same WiFi network. First, install the package:
Copy file name to clipboardExpand all lines: Tracking Streamer/Supporting files/Assets.xcassets/AppIcon.solidimagestack/Front.solidimagestacklayer/Content.imageset/Contents.json
Copy file name to clipboardExpand all lines: Tracking Streamer/Supporting files/Assets.xcassets/AppIcon.solidimagestack/Front.solidimagestacklayer/Contents.json
Copy file name to clipboardExpand all lines: Tracking Streamer/Supporting files/Assets.xcassets/AppIcon.solidimagestack/Middle.solidimagestacklayer/Content.imageset/Contents.json
0 commit comments