Skip to content

Commit 07f4bb1

Browse files
Enhance clarity in voice sentiment analysis learning path documentation
1 parent b961f5e commit 07f4bb1

3 files changed

Lines changed: 7 additions & 7 deletions

File tree

content/learning-paths/mobile-graphics-and-gaming/voice-sentiment-analysis-with-llm/1_overview.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,6 @@ Voice-based LLM applications often rely primarily on transcribed text from speec
1010

1111
To address this, voice-based sentiment classification analyzes audio input to determine the user's emotional state, which is then incorporated into the LLM prompt to enable more context-aware responses. In this Learning Path, you'll build a sentiment-aware voice assistant that runs entirely on-device. The application records audio, performs transcription—converting speech into written text—using Whisper, classifies sentiment directly from the voice signal, and combines the transcript and voice-based sentiment to guide responses from a local LLM running with llama.cpp.
1212

13-
![Voice sentiment classification pipeline#center](1_vsapipeline2.png "Voice sentiment classification pipeline")
13+
![Pipeline diagram showing audio input flowing through Whisper transcription and HuBERT sentiment classification, then both text and sentiment being combined into an LLM prompt that generates context-aware responses#center](1_vsapipeline2.png "Voice sentiment classification pipeline")
1414

15-
You will start by building a baseline voice-to-LLM pipeline—capturing audio, transcribing it into text, and using it to generate responses with an LLM. You will then extend this pipeline with a voice-based sentiment classification model. This involves training the model, optimizing it for efficient on-device inference, and integrating it into a unified application.
15+
You'll start by building a baseline voice-to-LLM pipeline—capturing audio, transcribing it into text, and using it to generate responses with an LLM. You'll then extend this pipeline with a voice-based sentiment classification model. This involves training the model, optimizing it for efficient on-device inference, and integrating it into a unified application.

content/learning-paths/mobile-graphics-and-gaming/voice-sentiment-analysis-with-llm/3_build-baseline-voice-to-llm-pipeline.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -8,10 +8,10 @@ layout: learningpathall
88

99
In this section, you'll build an end-to-end pipeline that:
1010

11-
1. Records audio from your microphone
12-
2. Transcribes it to text using Whisper
13-
3. Sends the text to a locally hosted LLM
14-
4. Displays the model's response
11+
- Records audio from your microphone
12+
- Transcribes it to text using Whisper
13+
- Sends the text to a locally hosted LLM
14+
- Displays the model's response
1515

1616
This forms the foundation of your voice assistant.
1717

content/learning-paths/mobile-graphics-and-gaming/voice-sentiment-analysis-with-llm/5_compress-and-convert-the-model.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -201,7 +201,7 @@ models/
201201

202202
You can also compare the model metrics before and after quantization.
203203

204-
![Model ONNX conversion and int-8 quantization results#center](4_modelconversionandcompression.png "Model ONNX conversion and int-8 quantization results")
204+
![Diagram showing model file sizes and performance metrics comparing the original ONNX model to the int-8 quantized version, demonstrating reduced size and improved inference speed#center](4_modelconversionandcompression.png "Model ONNX conversion and int-8 quantization results")
205205

206206
Typical results look like:
207207

0 commit comments

Comments
 (0)