You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/learning-paths/embedded-and-microcontrollers/raspberry-pi-smart-home/1-overview.md
+28-29Lines changed: 28 additions & 29 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,66 +8,65 @@ layout: learningpathall
8
8
9
9
## Overview
10
10
11
-
This Learning Path walks you through deploying an efficient large language model (LLM) locally on the Raspberry Pi 5, powered by an Arm Cortex-A76 CPU. This will allow you to control your smart home using natural language, without relying on cloud services. With rapid advances in Generative AI and the power of Arm Cortex-A processors, you can now run advanced language models directly in your home on the Raspberry Pi 5.
11
+
This Learning Path walks you through deploying an efficient large language model (LLM) locally on the Raspberry Pi 5, powered by an Arm Cortex-A76 CPU. This setup enables you to control your smart home using natural language without relying on cloud services. With rapid advances in generative AI and the power of Arm Cortex-A processors, you can now run advanced language models directly in your home on the Raspberry Pi 5.
12
12
13
-
You will create a fully local, privacy-first smart home system that leverages the strengths of Arm Cortex-A architecture. The system can achieve 15+ tokens per second inference speeds using optimized models like TinyLlama and Qwen, while maintaining the energy efficiency that makes Arm processors a good fit for always-on applications.
13
+
You will create a fully local, privacy-first smart home system that leverages the strengths of Arm Cortex-A architecture. The system can achieve 15+ tokens per second inference speeds using optimized models like TinyLlama and Qwen, while maintaining the energy efficiency that makes Arm processors well suited for always-on applications.
14
14
15
-
## Why Arm Cortex-A for Edge AI?
15
+
## Why Arm Cortex-A for edge AI?
16
16
17
17
The Raspberry Pi 5's Arm Cortex-A76 processor can manage high-performance computing tasks like AI inference. Key architectural features include:
18
18
19
-
-The **superscalar architecture** allows the processor to execute multiple instructions in parallel, improving throughput for compute-heavy tasks.
20
-
-**128-bit NEON SIMD support** accelerates matrix and vector operations, which are common in the inner loops of language model inference.
21
-
-The **multi-level cache hierarchy** helps reduce memory latency and improves data access efficiency during runtime.
22
-
-The **thermal efficiency** enables sustained performance without active cooling, making it ideal for compact or always-on smart home setups.
19
+
-**Superscalar architecture**: Executes multiple instructions in parallel, improving throughput for compute-heavy tasks
20
+
-**128-bit NEON SIMD support**: Accelerates matrix and vector operations, common in the inner loops of language model inference
21
+
-**Multi-level cache hierarchy**: Reduces memory latency and improves data access efficiency during runtime
22
+
-**Thermal efficiency**: Enables sustained performance without active cooling, making it ideal for compact or always-on smart home setups
23
23
24
-
These characteristics make the Raspberry Pi 5 well-suited for workloads like smart home assistants, where responsiveness, efficiency, and local processing are important. Running LLMs locally on Arm-based devices brings several practical benefits. Privacy is preserved, since conversations and routines never leave the device. With optimized inference, the system can offer responsiveness under 100 ms, even on resource-constrained hardware. It remains fully functional in offline scenarios, continuing to operate when internet access is unavailable. Developers also gain flexibility to customize models and automations. Additionally, software updates and an active ecosystem continue to improve performance over time.
24
+
These characteristics make the Raspberry Pi 5 wellsuited for workloads like smart home assistants, where responsiveness, efficiency, and local processing are important. Running LLMs locally on Arm-based devices brings several practical benefits. Privacy is preserved, since conversations and routines never leave the device. With optimized inference, the system can offer responsiveness under 100 ms, even on resource-constrained hardware. It remains fully functional in offline scenarios, continuing to operate when internet access is unavailable. Developers also gain flexibility to customize models and automations. Additionally, software updates and an active ecosystem continue to improve performance over time.
25
25
26
-
## Arm Ecosystem Advantages
26
+
## Arm ecosystem advantages
27
27
28
28
For the stack in this setup, Raspberry Pi 5 benefits from the extensive developer ecosystem:
29
29
30
30
- Optimized compilers including GCC and Clang with Arm-specific enhancements
31
31
- Native libraries such as gpiozero and lgpio are optimized for Raspberry Pi
32
-
- Community support from open-source projects where developers are contributing Arm-optimized code
33
-
-Arm maintains a strong focus on backward compatibility, which reduces friction when updating kernels or deploying across multiple Arm platforms
32
+
- Community support from open-source projects where developers contribute Arm-optimized code
33
+
-Backward compatibility in Arm architecture reduces friction when updating kernels or deploying across platforms
34
34
- The same architecture powers smartphones, embedded controllers, edge devices, and cloud infrastructure—enabling consistent development practices across domains
35
35
36
-
## Performance Benchmarks on Raspberry Pi 5
36
+
## Performance benchmarks on Raspberry Pi 5
37
37
38
38
The table below shows inference performance for several quantized models running on a Raspberry Pi 5. Measurements reflect single-threaded CPU inference with typical prompt lengths and temperature settings suitable for command-based interaction.
What does this table tell us? Here are some performance insights:
50
+
- Qwen 0.5B and TinyLlama 1.1B deliver fast token generation and low average latency, making them suitable for real-time interactions such as voice-controlled smart home commands
51
+
- DeepSeek-Coder 1.3B and Gemma 2B trade some speed for improved language understanding, which can be useful for complex tasks or context-aware prompts
52
+
- DeepSeek-R1 7B offers advanced reasoning capabilities with acceptable latency, which may be viable for offline summarization, planning, or low-frequency tasks
50
53
51
-
- Qwen 0.5B and TinyLlama 1.1B deliver fast token generation and low average latency, making them suitable for real-time interactions like voice-controlled smart home commands.
52
-
- DeepSeek-Coder 1.3B and Gemma 2B trade off some speed for improved language understanding, which can be useful for more complex task execution or context-aware prompts.
53
-
- DeepSeek-R1 7B offers advanced reasoning capabilities with acceptable latency, which may be viable for offline summarization, planning, or low-frequency tasks.
54
+
## Supported Arm-powered devices
54
55
55
-
## Supported Arm-Powered Devices
56
+
This Learning Path focuses on the Raspberry Pi 5, but you can adapt the concepts and code to other Arm-powered devices.
56
57
57
-
This Learning Path focuses on the Raspberry Pi 5, but you can adapt the concepts and code to other Arm-powered devices:
58
+
### Recommended platforms
58
59
59
-
### Recommended Platforms
60
+
| Platform | CPU | RAM | GPIO support | Model size suitability |
|**Raspberry Pi 5**| Arm Cortex-A76 quad-core @ 2.4GHz | Up to 16GB | Native `lgpio` (high-performance) | Large models (8–16GB) |
64
-
|**Raspberry Pi 4**| Arm Cortex-A72 quad-core @ 1.8GHz | Up to 8GB | Compatible with `gpiozero`| Small to mid-size models |
65
-
|**Other Arm Devices**| Arm Cortex-A | 4GB min (8GB+ recommended) | Requires physical GPIO pins | Varies by RAM |
66
-
67
-
Additionally, the platform must:
66
+
Additionally, the platform must meet the following requirements:
68
67
69
68
- GPIO pins available for hardware control
70
-
-Use Python 3.8 or newer
69
+
- Python 3.8 or newer
71
70
- Ability to run [Ollama](https://ollama.com/)
72
71
73
-
Continue to the next section to start building a smart home system that highlights how Arm-based processors can enable efficient, responsive, and private AI applications at the edge.
72
+
Continue to the next section to start building a smart home system that highlights how Arm-based processors enable efficient, responsive, and private AI applications at the edge.
Copy file name to clipboardExpand all lines: content/learning-paths/embedded-and-microcontrollers/raspberry-pi-smart-home/2-software-dependencies.md
+27-25Lines changed: 27 additions & 25 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,54 +10,54 @@ layout: learningpathall
10
10
This guide assumes you have set up your Raspberry Pi with Raspberry Pi OS and network connectivity. For Raspberry Pi 5 setup help, see: [Raspberry Pi Getting Started](https://www.raspberrypi.com/documentation/)
11
11
{{% /notice %}}
12
12
13
-
## Connect to Your Raspberry Pi 5
13
+
## Connect to your Raspberry Pi 5
14
14
15
-
### Option 1: Using a display
15
+
### Option 1: Use a display
16
16
17
-
The easiest way to work on your Raspberry Pi is connecting it to an external display through one of the microHDMI ports. This setup also requires a keyboard and mouse to navigate.
17
+
The easiest way to work on your Raspberry Pi is by connecting it to an external display through one of the micro‑HDMI ports. This setup also requires a keyboard and mouse.
18
18
19
-
### Option 2: Using SSH
19
+
### Option 2: Use SSH
20
20
21
-
You can also use SSH to access the terminal. To use this approach you need to know the IP address of your device. Ensure your Raspberry Pi 5 connects to the same network as your host computer. Access your device remotely via SSH using the terminal or any SSH client.
21
+
You can also use SSH to access the terminal. To use this approach, you need to know the IP address of your device. Ensure your Raspberry Pi 5 is on the same network as your host computer. Access your device remotely via SSH using the terminal or any SSH client.
22
22
23
23
Replace `<user>` with your Pi's username (typically `pi`), and `<pi-ip>` with your Raspberry Pi 5's IP address.
24
24
25
25
```bash
26
26
ssh <user>@<pi-ip>
27
27
```
28
28
29
-
## Set up the dependencies
29
+
## Set up dependencies
30
30
31
31
Create a directory called `smart-home` in your home directory and navigate into it:
32
32
33
33
```bash
34
-
mkdir $HOME/smart-home
35
-
cd$HOME/smart-home
34
+
mkdir -p "$HOME/smart-home"
35
+
cd"$HOME/smart-home"
36
36
```
37
37
38
-
The Raspberry Pi 5 includes Python 3 pre-installed, but you need additional packages:
38
+
The Raspberry Pi 5 includes Python 3 preinstalled, but you need additional packages:
The next step is to create and activate a Python virtual environment. This approach keeps project dependencies isolated and prevents conflicts with system-wide packages:
47
+
Create and activate a Python virtual environment to isolate project dependencies:
Install Ollama using the official installation script for Linux:
63
63
@@ -70,27 +70,29 @@ Verify the installation:
70
70
```bash
71
71
ollama --version
72
72
```
73
-
If installation was successful, the output from the command should match that below.
73
+
74
+
If installation was successful, the output should be similar to:
75
+
74
76
```output
75
77
ollama version is 0.11.4
76
78
```
77
79
78
-
## Download and Test a Language Model
80
+
## Download and test a language model
79
81
80
-
Ollama supports various models. This guide uses deepseek-r1:7b as an example, but you can also use `tinyllama:1.1b`, `qwen:0.5b`, `gemma2:2b`, or `deepseek-coder:1.3b`.
82
+
Ollama supports various models. This guide uses `deepseek-r1:7b` as an example, but you can also use `tinyllama:1.1b`, `qwen:0.5b`, `gemma2:2b`, or `deepseek-coder:1.3b`.
81
83
82
-
The `run` command will set up the model automatically. You will see download progress in the terminal, followed by the interactive prompt when ready.
84
+
The `run` command sets up the model automatically. You will see download progress in the terminal, followed by an interactive prompt when ready.
83
85
84
86
```bash
85
87
ollama run deepseek-r1:7b
86
88
```
87
89
88
90
{{% notice Troubleshooting %}}
89
-
If you run into issues with the model download, here are some things to check:
91
+
If you run into issues with the model download, try the following:
90
92
91
-
- Confirm internet access and sufficient storage space on your microSD card
92
-
- Try downloading smaller models like `qwen:0.5b` or `tinyllama:1.1b` if you encounter memory issues. 16 GB of RAM is sufficient for running smaller to medium-sized language models. Very large models may require more memory or run slower.
93
-
- Clear storage or connect to a more stable network if errors occur
93
+
- Confirm internet access and sufficient storage space on your microSD card.
94
+
- Try smaller models like `qwen:0.5b` or `tinyllama:1.1b` if you encounter memory issues. 16 GB of RAM is sufficient for small to mediummodels; very large models may require more memory or run slower.
95
+
- Clear storage or connect to a more stable network if errors occur.
94
96
{{% /notice %}}
95
97
96
-
With the model set up through `ollama`, move on to the next section to start configuring the hardware.
98
+
With the model set up through Ollama, move on to the next section to start configuring the hardware.
Copy file name to clipboardExpand all lines: content/learning-paths/embedded-and-microcontrollers/raspberry-pi-smart-home/3-test-gpio.md
+16-15Lines changed: 16 additions & 15 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,11 +6,11 @@ weight: 4
6
6
layout: learningpathall
7
7
---
8
8
9
-
The next step is to test the GPIO functionality. In this section, you will configure a LED light to simulate a smart-home device.
9
+
The next step is to test the GPIO functionality. In this section, you configure an LED light to simulate a smarthome device.
10
10
11
-
## Verify GPIO Functionality
11
+
## Verify GPIO functionality
12
12
13
-
Bring out your electronics components. Connect the anode (long leg) of an LED in series with a 220Ω resistor to GPIO 17 (physical pin 11). Connect the cathode (short leg) to a ground (GND) pin. See image below for the full setup:
13
+
Gather your electronic components. Connect the anode (long leg) of an LED in series with a 220Ω resistor to GPIO 17 (physical pin 11). Connect the cathode (short leg) to a ground (GND) pin. See the image below for the full setup:
14
14
15
15
![Raspberry Pi connected to a breadboard with a green LED and jumper wires](pin_layout.jpg"Raspberry Pi connected to a breadboard with a green LED and jumper wires")
16
16
@@ -21,7 +21,7 @@ cd $HOME/smart-home
21
21
vim testgpio.py
22
22
```
23
23
24
-
Copy this code into the file:
24
+
Add the following code to the file:
25
25
26
26
```python
27
27
#!/usr/bin/env python3
@@ -32,7 +32,7 @@ from gpiozero.pins.lgpio import LGPIOFactory
32
32
# Set lgpio backend for Raspberry Pi 5
33
33
Device.pin_factory = LGPIOFactory()
34
34
35
-
#Setup GPIO pin 17
35
+
#Set up GPIO pin 17
36
36
pin1 = LED(17)
37
37
38
38
try:
@@ -52,19 +52,20 @@ python testgpio.py
52
52
The LED should blink every two seconds. If you observe this behavior, your GPIO setup works correctly.
53
53
54
54
{{% notice Troubleshooting %}}
55
-
If you run into issues with the hardware setup, here are some things to check:
56
-
- Try fixing missing dependencies by running the following command:
57
-
```bash
58
-
sudo apt-get install -f
59
-
```
60
-
- If you're running into GPIO permission issues, run Python scripts with `sudo` or add your user to the `gpio` group. Don't forget to log out for the changes to take effect.
61
-
```bash
62
-
sudo usermod -a -G gpio $USER
63
-
```
55
+
If you run into issues with the hardware setup, check the following:
56
+
57
+
- Fix missing dependencies with:
58
+
```bash
59
+
sudo apt-get install -f
60
+
```
61
+
- If you encounter GPIO permission issues, run Python scripts with `sudo` or add your user to the `gpio` group. Don’t forget to log out for the changes to take effect:
62
+
```bash
63
+
sudo usermod -a -G gpio $USER
64
+
```
64
65
- Double-check wiring and pin numbers using the Raspberry Pi 5 pinout diagram
65
66
- Ensure proper LED and resistor connections
66
67
- Verify GPIO enablement in `raspi-config` if needed
67
68
- Use a high-quality power supply
68
69
{{% /notice %}}
69
70
70
-
With a way to control devices using GPIO pins, you can move on to the next section to interact with them using language models and the user interface.
71
+
With GPIO pins working, you can now move on to the next section to interact with devices using language models and the user interface.
@@ -69,15 +69,15 @@ If everything is set up correctly, you should see the following output on runnin
69
69
70
70
![Running in Default Mode](cmd.png"Running the code in default mode")
71
71
72
-
## Interact With Your Assistant
72
+
## Interact with your assistant
73
73
74
74
Try asking the assistant to `turn on living room light`. If you've connected additional devices, come up with prompts to test the setup.
75
75
76
76
### Web interface
77
77
78
-
Open your browser and navigate to `http://0.0.0.0:8000`, or as printed in the terminal output.
78
+
Open your browser and navigate to `http://0.0.0.0:8000`, or as printed in the terminal output.
79
79
80
-
![Web Interface Interaction](UI3.png"Interacting with the LLM through the web interface")
80
+
![Web Interface Interaction](UI3.png"Interacting with the LLM through the web interface")
81
81
82
82
83
83
### Command line interface
@@ -105,9 +105,8 @@ If you're running into issues with the assistant, here are some things to check:
105
105
- If port 8000 is unavailable, run the assistant with a different port using the `--port` flag.
106
106
{{% /notice %}}
107
107
108
-
## Wrapping up
108
+
## Wrap up
109
109
110
110
From here, you can modify the `smart_home_assistant.py` and extend the system by adding more devices, experimenting with conversational commands, or integrating sensors and automation logic into your smart home setup.
111
111
112
112
You should now know more about setting up a Raspberry Pi 5 to control real-world devices using GPIO pins, and running a smart home assistant powered by local language models through Ollama. You’ve learned how to wire basic circuits with LEDs and resistors to simulate smart devices, and how to launch and interact with the assistant through both the command-line interface and a web dashboard. Along the way, you also explored common troubleshooting steps for GPIO access, missing dependencies, and model loading issues.
0 commit comments