@@ -25,49 +25,48 @@ prerequisites:
2525# START generated_summary_faq
2626generated_summary_faq :
2727 template_version : summary-faq-v3
28- generated_at : ' 2026-07-02T17:15:58Z '
28+ generated_at : ' 2026-07-02T19:04:59Z '
2929 generator : ai
3030 ai_assisted : true
3131 ai_review_required : true
3232 model : gpt-5
3333 prompt_template : summary-faq-v3
3434 source_hash : d021122b9217e2326e98d45aeffccb742357e77a7774f9c469d2c73285ca91a9
35- summary_generated_at : ' 2026-07-02T17:15:58Z '
35+ summary_generated_at : ' 2026-07-02T19:04:59Z '
3636 summary_source_hash : d021122b9217e2326e98d45aeffccb742357e77a7774f9c469d2c73285ca91a9
37- faq_generated_at : ' 2026-07-02T17:15:58Z '
37+ faq_generated_at : ' 2026-07-02T19:04:59Z '
3838 faq_source_hash : d021122b9217e2326e98d45aeffccb742357e77a7774f9c469d2c73285ca91a9
3939 summary : >-
40- This Learning Path guides you to build a distributed edge AI application where a Raspberry
41- Pi 5 performs on-device gesture recognition with MediaPipe and TensorFlow Lite and sends commands
42- to a Reachy Mini robot running in a MuJoCo simulation on a development machine. You set up
43- the Pi, enable Git LFS to retrieve the gesture model, run the app, and open a browser dashboard
44- on port 8042 to deliver thumbs-up or thumbs-down verdicts that trigger Reachy’s reactions.
45- The steps explain how the Pi connects to the robot daemon over the network and how to operate
46- the dashboard, then walk through the code structure that separates perception, logic, robot
47- motion, and static assets so you can extend or adapt the project.
40+ You'll build a distributed edge AI application that runs MediaPipe
41+ gesture inference on a Raspberry Pi 5 and drives a Reachy Mini robot in a MuJoCo simulation.
42+ First, you'll start the simulator on a development machine, prepare the Pi with Raspberry Pi OS and
43+ Git LFS so the gesture model downloads correctly, then run the app and open a browser dashboard
44+ to monitor the camera feed and verdicts. A thumbs-up or thumbs-down from the webcam triggers
45+ victory or defeat motions in the simulated robot. You'll also learn about the project layout
46+ so you can locate perception, app logic, motion, and dashboard components in the codebase to iterate on.
4847 faqs :
49- - question : I cloned the project but the gesture model file is tiny—did Git LFS work ?
48+ - question : Which address should I open to view the dashboard ?
5049 answer : >-
51- Verify that you installed and enabled Git LFS before cloning. Re-clone with LFS enabled
52- and check that assets/gesture_recognizer.task is a large binary file, not a small text pointer .
53- - question : The dashboard doesn’t open at http://localhost:8042—what should I try ?
50+ If you use VS Code Remote SSH port forwarding, open `http://localhost:8042` on your laptop.
51+ Otherwise, browse to `http://<pi-ip-address>:8042` from any machine on the same network .
52+ - question : How do I find the Raspberry Pi IP address for the dashboard ?
5453 answer : >-
55- If you use VS Code Remote SSH, confirm that port forwarding is active. Otherwise, open http://<pi-ip- address>:8042
56- from a browser on the same network and make sure the app is running on the Raspberry Pi .
57- - question : How do I know the Raspberry Pi is connected to the MuJoCo simulation ?
54+ Run `hostname -I` on the Raspberry Pi to print its IP address. Then use that address with
55+ port `8042` in your browser .
56+ - question : How do I confirm the gesture model downloaded correctly with Git LFS ?
5857 answer : >-
59- When you show a thumbs-up or thumbs-down, the simulated Reachy Mini should perform the corresponding
60- victory or defeat reaction. If nothing happens, check that both machines are on the same
61- network and that the connection settings in main.py point to the correct host.
62- - question : Can I run the Raspberry Pi headless for this app?
58+ Check that `assets/gesture_recognizer.task` exists as a real model file, not a tiny pointer
59+ file. If you cloned before enabling Git LFS, enable LFS and re-clone the repository.
60+ - question : The dashboard loads but the MuJoCo simulation does not move—what should I check?
6361 answer : >-
64- Yes. Open the dashboard from another machine using the Raspberry Pi’s IP address and port
65- 8042; the Pi does not need a local display.
66- - question : Where do I change gesture handling or robot moves in the code?
62+ Verify the MuJoCo simulation is running on your development machine and that the Pi can
63+ reach it over the network. Also review `main.py` because it contains the settings used for
64+ the distributed simulation route.
65+ - question : What result should I expect when a thumbs-up or thumbs-down is detected?
6766 answer : >-
68- Edit gesture.py to adjust recognition or mapping and moves.py to change motion routines.
69- Use main.py to wire the app and update the settings used for the distributed simulation
70- route .
67+ You should see the simulated Reachy Mini play a victory or defeat motion, and the web dashboard
68+ should reflect the verdict. This indicates the camera, inference, network, and simulator
69+ are connected end to end .
7170# END generated_summary_faq
7271
7372author : Matt Cossins
@@ -123,4 +122,3 @@ weight: 1 # _index.md always has weight of 1 to order corr
123122layout : " learningpathall" # All files under learning paths have this same wrapper
124123learning_path_main_page : " yes" # This should be surfaced when looking for related content. Only set for _index.md of learning path content.
125124---
126-
0 commit comments