@@ -69,6 +69,50 @@ Each evaluation is run without restarting Isaac Sim to save on the startup time.
6969 9 closed-loop evaluation runs of GR00T N1.6 on the DROID embodiment — each cell varies the
7070 pick-up object, background HDR, and destination.
7171
72+ At the end of the run you will see a job summary table followed by a metrics report:
73+
74+ .. code-block :: text
75+
76+ +---------------------------------------+-----------+-----...-+----------+-----------+--------------+
77+ | Job Name | Status | Policy | Num Envs | Num Steps | Num Episodes |
78+ +---------------------------------------+-----------+-----...-+----------+-----------+--------------+
79+ | droid_pnp_srl_gr00t_billiard_hall | completed | Gr00t.. | 1 | None | 3 |
80+ | droid_pnp_srl_gr00t_blue_block | completed | Gr00t.. | 1 | None | 3 |
81+ | droid_pnp_srl_gr00t_alphabet_soup_can | completed | Gr00t.. | 1 | None | 3 |
82+ | droid_pnp_srl_gr00t_orange | completed | Gr00t.. | 1 | None | 3 |
83+ | droid_pnp_srl_gr00t_lemon | completed | Gr00t.. | 1 | None | 3 |
84+ | droid_pnp_srl_gr00t_tomato_sauce_can | completed | Gr00t.. | 1 | None | 3 |
85+ | droid_pnp_srl_gr00t_mustard_bottle | completed | Gr00t.. | 1 | None | 3 |
86+ | droid_pnp_srl_gr00t_sugar_box | completed | Gr00t.. | 1 | None | 3 |
87+ | droid_pnp_srl_gr00t_mug | completed | Gr00t.. | 1 | None | 3 |
88+ +---------------------------------------+-----------+-----...-+----------+-----------+--------------+
89+
90+ ======================================================================
91+ METRICS SUMMARY
92+ ======================================================================
93+
94+ droid_pnp_srl_gr00t_alphabet_soup_can:
95+ num_episodes 3
96+ object_moved_rate 0.0000
97+ success_rate 0.0000
98+
99+ droid_pnp_srl_gr00t_lemon:
100+ num_episodes 3
101+ object_moved_rate 1.0000
102+ success_rate 0.6667
103+
104+ droid_pnp_srl_gr00t_billiard_hall:
105+ num_episodes 3
106+ object_moved_rate 0.3333
107+ success_rate 0.0000
108+
109+ droid_pnp_srl_gr00t_blue_block:
110+ num_episodes 3
111+ object_moved_rate 0.0000
112+ success_rate 0.0000
113+
114+ ...
115+
72116
73117 .. _Next Steps :
74118
0 commit comments