Skip to content

Commit feb2429

Browse files
authored
Merge pull request #1928 from pareenaverma/content_review
First tech review on voice assistant LP
2 parents a48d5e9 + 1aec802 commit feb2429

5 files changed

Lines changed: 40 additions & 38 deletions

File tree

Lines changed: 7 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,16 +1,16 @@
11
---
2-
title: Prerequisites
2+
title: Development environment
33
weight: 3
44

55
### FIXED, DO NOT MODIFY
66
layout: learningpathall
77
---
88

9-
## Install software required for this Learning Path
9+
## Install dependencies
1010

11-
In this learning path, you will compile an Android application, so you first need to download and install the latest version of [Android Studio](https://developer.android.com/studio) on your computer.
11+
In this learning path, you will compile an Android application, so you first need to download and install the latest version of [Android Studio](https://developer.android.com/studio) on your development machine.
1212

13-
You then need to ensure you have the following tools:
13+
You then need to install the following tools:
1414
- `cmake`, the software build system
1515
- `git`, the version control system for cloning the Voice Assistant codebase
1616
- `adb`, the Android Debug Bridge, a command-line tool to communicate with a device and perform various commands on it
@@ -19,9 +19,10 @@ These tools can be installed by running the following command (depending on your
1919

2020
{{< tabpane code=true >}}
2121
{{< tab header="Linux/Ubuntu" language="bash">}}
22-
sudo apt install git adb cmake
22+
sudo apt update
23+
sudo apt install git adb cmake -y
2324
{{< /tab >}}
2425
{{< tab header="macOS" language="bash">}}
2526
brew install git android-platform-tools cmake
2627
{{< /tab >}}
27-
{{< /tabpane >}}
28+
{{< /tabpane >}}

content/learning-paths/mobile-graphics-and-gaming/voice-assistant/2-overview.md

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -6,25 +6,25 @@ weight: 4
66
layout: learningpathall
77
---
88

9-
The Voice Assistant is an example application that demonstrates a complete voice interaction pipeline for Android.
9+
The Voice Assistant application demonstrates an example of a complete voice interaction pipeline for Android.
1010

1111
It generates intelligent responses by utilizing:
12-
1. Speech-to-Text (STT) to transform the user's audio prompt into a text representation,
13-
2. a Large Language Model (LLM) to answer the user's prompt in text form,
14-
3. the Android Text-to-Speech (TTS) API is then used to produce a voice response.
12+
1. Speech-to-Text (STT) to transform the user's audio prompt into a text representation
13+
2. A Large Language Model (LLM) to respond to the user's prompt in text form
14+
3. Android Text-to-Speech (TTS) API to produce a voice response.
1515

1616
![example image alt-text#center](overview.png "Figure 1: Overview")
1717

18-
These three steps correspond to specific components used in the Voice Assistant application. A more detailed description of each one follows.
18+
These three steps correspond to specific components used in the Voice Assistant application. A more detailed description of each step is provided.
1919

2020
## Speech to Text Library
2121

2222
Speech-to-Text is also known as Automatic Speech Recognition. This part of the pipeline focuses on converting spoken language into written text.
2323

2424
Speech recognition is done in the following stages:
25-
- The device's microphone captures spoken language as an audio waveform,
26-
- The audio waveform is broken into small time frames, and features are extracted to represent sound,
27-
- A neural network is used to predict the most likely transcription of audio based on grammar and context,
25+
- The device's microphone captures spoken language as an audio waveform.
26+
- The audio waveform is broken into small time frames, and features are extracted to represent sound.
27+
- A neural network is used to predict the most likely transcription of audio based on grammar and context.
2828
- The final recognized text is generated for the next stage of the pipeline.
2929

3030
## Large Language Models Library
@@ -35,6 +35,6 @@ The text transcription from the previous part of the pipeline is used as input t
3535

3636
## Text to Speech Component
3737

38-
Currently, this part of the application pipeline uses the Android Text-to-Speech API with some extra functionality to ensure smooth and natural speech output.
38+
This part of the application pipeline uses the Android Text-to-Speech API with some extra functionality to ensure smooth and natural speech output.
3939

40-
In synchronous mode, speech is only generated after the full response from the LLM is received. By default, the application operates in asynchronous mode, where speech synthesis starts as soon as a sufficient portion of the response (such as a half or full sentence) is available. Any additional responses are queued for processing by the Android Text-to-Speech engine.
40+
In synchronous mode, speech is only generated after the full response from the LLM is received. By default, the application operates in asynchronous mode, where speech synthesis starts as soon as a sufficient portion of the response (such as a half or full sentence) is available. Any additional responses are queued for processing by the Android Text-to-Speech engine.

content/learning-paths/mobile-graphics-and-gaming/voice-assistant/3-build.md

Lines changed: 12 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -6,24 +6,30 @@ weight: 5
66
layout: learningpathall
77
---
88

9+
In this section you will build the Voice Assistant application to run on your Android phone.
10+
911
## Download the Voice Assistant
1012

11-
```BASH
13+
Start by cloning the repository with the complete example application code:
14+
15+
```bash
1216
git clone https://git.gitlab.arm.com/kleidi/kleidi-examples/real-time-voice-assistant.git voice-assistant.git
1317
```
1418

1519
## Build the Voice Assistant
1620

17-
Open Android Studio and open the project that you just downloaded in the preceding step:
21+
Open Android Studio and open the project that you downloaded in the previous step:
1822

1923
![example image alt-text#center](open_project.png "Figure 2: Open the project in Android Studio.")
2024

2125
Build the application with its default settings by clicking the little hammer
22-
"Make Module 'VoiceAssistant.app'" button in the upper right corner:
26+
"Make Module `VoiceAssistant.app`" button in the upper right corner:
2327

2428
![example image alt-text#center](build_project.png "Figure 3: Build the project.")
2529

26-
Android Studio will start the build, which may take some time if it needs to
27-
download some dependencies of the Voice Assistant app:
30+
Android Studio will start the build. The build may take some time if it needs to
31+
download some dependencies for the Voice Assistant app that are not already installed:
32+
33+
![example image alt-text#center](build_success.png "Figure 4: Successful build!")
2834

29-
![example image alt-text#center](build_success.png "Figure 4: Successful build!")
35+
Now that you have successfully built the Android application, you will run it in the next step.

content/learning-paths/mobile-graphics-and-gaming/voice-assistant/4-run.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ weight: 6
77
layout: learningpathall
88
---
99

10-
In the previous section, we built the Voice Assistant app. Now, we need to install it on the phone. The easiest way to do this is to put the Android phone in developer mode and use a USB cable to upload the application.
10+
In the previous section, you built the Voice Assistant application. Now, you will install this application on your Android phone. The easiest way to do this is to put your Android phone in developer mode and use a USB cable to upload the application.
1111

1212
## Switch your phone to developer mode
1313

@@ -26,7 +26,7 @@ The Voice Assistant will welcome you with this screen:
2626

2727
![example image alt-text#center](voice_assistant_view1.png "Figure 6: Welcome Screen")
2828

29-
You can now press the part at the bottom and make your request!
29+
You can now use the Press to Talk at the bottom and make your request!
3030

3131
## Voice Assistant Controls
3232

content/learning-paths/mobile-graphics-and-gaming/voice-assistant/_index.md

Lines changed: 9 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -1,29 +1,24 @@
11
---
22
title: Accelerate a Voice Assistant with KleidiAI and SME2
33

4+
draft: true
5+
cascade:
6+
draft: true
7+
48
minutes_to_complete: 30
59

6-
who_is_this_for: This Learning Path is an introductory topic on improving the performances of a voice assistant by using KleidiAI and SME2.
10+
who_is_this_for: This is an introductory topic for software developers interested in running a voice assistant with improved performance on their Android phones by using KleidiAI and SME2.
711

812
learning_objectives:
9-
- Compile an Android application
10-
- Use KleidAI and SME2 to improve the performance of the voice assistant
13+
- Learn how to compile a voice assistant Android application.
14+
- Use KleidiAI and SME2 to improve the performance of the voice assistant.
1115

1216
prerequisites:
13-
- an Android phone
14-
- Android Studio
15-
- CMake
16-
- adb
17-
- git
17+
- An Android phone with support for i8mm (tested on Google Pixel 8 Pro).
18+
- A development machine with [Android Studio](https://developer.android.com/studio) installed.
1819

1920
author: Arnaud de Grandmaison
2021

21-
test_images:
22-
- ubuntu:latest
23-
test_link: null
24-
test_maintenance: true
25-
26-
### Tags
2722
skilllevels: Introductory
2823
subjects: Performance and Architecture
2924
armips:

0 commit comments

Comments
 (0)