Skip to content

Commit e68bb56

Browse files
rwiltzrwiltz
committed
Updating docs, explicitly call out physicx support and handtracking requirment for teleop envs
1 parent 5afbca4 commit e68bb56

2 files changed

Lines changed: 39 additions & 21 deletions

File tree

‎docs/source/how-to/cloudxr_teleoperation.rst‎

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -120,6 +120,14 @@ terminal or ``source`` step is needed. Launch a teleoperation script directly:
120120
--visualizer kit \
121121
--xr
122122
123+
.. tip::
124+
125+
The ``Isaac-PickPlace-GR1T2-WaistEnabled-Abs-v0`` task above uses **hand tracking** as its
126+
input mode. Make sure your XR device has hand tracking enabled (optical hand tracking on
127+
Quest 3, or the built-in hand tracking on Apple Vision Pro). Different tasks require
128+
different input modes (motion controllers vs hand tracking) -- see the
129+
:ref:`isaac-teleop-control-schemes` table for the full list.
130+
123131
To switch the CloudXR device profile at launch time (e.g. from Quest to Apple Vision Pro),
124132
use the ``--cloudxr_env`` flag:
125133

‎docs/source/overview/environments.rst‎

Lines changed: 31 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -148,17 +148,17 @@ for the lift-cube environment:
148148
| | | | ``segmentation``, |
149149
| | | | ``simple_shading_*`` |
150150
+-------------------------+------------------------------+-----------------------------------------------------------------------------+-----------------------+
151-
| |gr1_pick_place| | |gr1_pick_place-link| | Pick up and place an object in a basket with a GR-1 humanoid robot | |
151+
| |gr1_pick_place| | |gr1_pick_place-link| | Pick up and place an object in a basket with a GR-1 humanoid robot | ``physx`` |
152152
+-------------------------+------------------------------+-----------------------------------------------------------------------------+-----------------------+
153-
| |gr1_pp_waist| | |gr1_pp_waist-link| | Pick up and place an object in a basket with a GR-1 humanoid robot | |
153+
| |gr1_pp_waist| | |gr1_pp_waist-link| | Pick up and place an object in a basket with a GR-1 humanoid robot | ``physx`` |
154154
| | | with waist degrees-of-freedom enables that provides a wider reach space. | |
155155
+-------------------------+------------------------------+-----------------------------------------------------------------------------+-----------------------+
156-
| |g1_pick_place| | |g1_pick_place-link| | Pick up and place an object in a basket with a Unitree G1 humanoid robot | |
156+
| |g1_pick_place| | |g1_pick_place-link| | Pick up and place an object in a basket with a Unitree G1 humanoid robot | ``physx`` |
157157
+-------------------------+------------------------------+-----------------------------------------------------------------------------+-----------------------+
158-
| |g1_pick_place_fixed| | |g1_pick_place_fixed-link| | Pick up and place an object in a basket with a Unitree G1 humanoid robot | |
158+
| |g1_pick_place_fixed| | |g1_pick_place_fixed-link| | Pick up and place an object in a basket with a Unitree G1 humanoid robot | ``physx`` |
159159
| | | with three-fingered hands. Robot is set up with the base fixed in place. | |
160160
+-------------------------+------------------------------+-----------------------------------------------------------------------------+-----------------------+
161-
| |g1_pick_place_lm| | |g1_pick_place_lm-link| | Pick up and place an object in a basket with a Unitree G1 humanoid robot | |
161+
| |g1_pick_place_lm| | |g1_pick_place_lm-link| | Pick up and place an object in a basket with a Unitree G1 humanoid robot | ``physx`` |
162162
| | | with three-fingered hands and in-place locomanipulation capabilities | |
163163
| | | enabled (i.e. Robot lower body balances in-place while upper body is | |
164164
| | | controlled via Inverse Kinematics). | |
@@ -189,7 +189,7 @@ for the lift-cube environment:
189189
| | | | ``simple_shading_*`` |
190190
| | | | ``{64,128,256}`` |
191191
+-------------------------+------------------------------+-----------------------------------------------------------------------------+-----------------------+
192-
| |galbot_stack| | |galbot_stack-link| | Stack three cubes (bottom to top: blue, red, green) with the left arm of | |
192+
| |galbot_stack| | |galbot_stack-link| | Stack three cubes (bottom to top: blue, red, green) with the left arm of | ``physx`` |
193193
| | | a Galbot humanoid robot | |
194194
+-------------------------+------------------------------+-----------------------------------------------------------------------------+-----------------------+
195195
| |agibot_place_mug| | |agibot_place_mug-link| | Pick up and place a mug upright with a Agibot A2D humanoid robot | |
@@ -1108,6 +1108,11 @@ inferencing, including reading from an already trained checkpoint and disabling
11081108
- Manager Based
11091109
-
11101110
-
1111+
* - Isaac-Stack-Cube-Franka-IK-Abs-v0
1112+
-
1113+
- Manager Based
1114+
-
1115+
- ``physx``
11111116
* - Isaac-Dexsuite-Kuka-Allegro-Lift-v0
11121117

11131118
Camera variants (requires ``--enable_cameras``):
@@ -1156,38 +1161,43 @@ inferencing, including reading from an already trained checkpoint and disabling
11561161
-
11571162
- Manager Based
11581163
-
1159-
-
1160-
* - Isaac-Stack-Cube-UR10-Long-Suction-IK-Rel-v0
1164+
- ``physx``
1165+
* - Isaac-PickPlace-GR1T2-Abs-v0
11611166
-
11621167
- Manager Based
11631168
-
1164-
-
1165-
* - Isaac-Stack-Cube-UR10-Short-Suction-IK-Rel-v0
1169+
- ``physx``
1170+
* - Isaac-PickPlace-GR1T2-WaistEnabled-Abs-v0
11661171
-
11671172
- Manager Based
11681173
-
1169-
-
1170-
* - Isaac-Stack-Cube-Galbot-Left-Arm-Gripper-RmpFlow-v0
1174+
- ``physx``
1175+
* - Isaac-NutPour-GR1T2-Pink-IK-Abs-v0
11711176
-
11721177
- Manager Based
11731178
-
1174-
-
1175-
* - Isaac-Stack-Cube-Galbot-Right-Arm-Suction-RmpFlow-v0
1179+
- ``physx``
1180+
* - Isaac-ExhaustPipe-GR1T2-Pink-IK-Abs-v0
11761181
-
11771182
- Manager Based
11781183
-
1184+
- ``physx``
1185+
* - Isaac-PickPlace-Locomanipulation-G1-Abs-v0
11791186
-
1180-
* - Isaac-Stack-Cube-Galbot-Left-Arm-Gripper-Visuomotor-v0
1181-
- Isaac-Stack-Cube-Galbot-Left-Arm-Gripper-Visuomotor-Play-v0
11821187
- Manager Based
11831188
-
1189+
- ``physx``
1190+
* - Isaac-PickPlace-FixedBaseUpperBodyIK-G1-Abs-v0
11841191
-
1185-
* - Isaac-Place-Mug-Agibot-Left-Arm-RmpFlow-v0
1192+
- Manager Based
1193+
-
1194+
- ``physx``
1195+
* - Isaac-Stack-Cube-UR10-Long-Suction-IK-Rel-v0
11861196
-
11871197
- Manager Based
11881198
-
11891199
-
1190-
* - Isaac-Place-Toy2Box-Agibot-Right-Arm-RmpFlow-v0
1200+
* - Isaac-Stack-Cube-UR10-Short-Suction-IK-Rel-v0
11911201
-
11921202
- Manager Based
11931203
-
@@ -1196,17 +1206,17 @@ inferencing, including reading from an already trained checkpoint and disabling
11961206
-
11971207
- Manager Based
11981208
-
1199-
-
1209+
- ``physx``
12001210
* - Isaac-Stack-Cube-Galbot-Right-Arm-Suction-RmpFlow-v0
12011211
-
12021212
- Manager Based
12031213
-
1204-
-
1214+
- ``physx``
12051215
* - Isaac-Stack-Cube-Galbot-Left-Arm-Gripper-Visuomotor-v0
12061216
- Isaac-Stack-Cube-Galbot-Left-Arm-Gripper-Visuomotor-Play-v0
12071217
- Manager Based
12081218
-
1209-
-
1219+
- ``physx``
12101220
* - Isaac-Place-Mug-Agibot-Left-Arm-RmpFlow-v0
12111221
-
12121222
- Manager Based

0 commit comments

Comments
 (0)