Skip to content

Commit 5fe8dd4

Browse files
committed
update performance table section with more explanation of stats shown
1 parent b6f6e89 commit 5fe8dd4

1 file changed

Lines changed: 6 additions & 7 deletions

File tree

  • content/learning-paths/mobile-graphics-and-gaming/voice-assistant

content/learning-paths/mobile-graphics-and-gaming/voice-assistant/6-performance.md

Lines changed: 6 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -127,18 +127,17 @@ To get benchmark numbers with use of SME kernels, you can rerun the full Benchma
127127

128128
## Example performance with a Vivo X300 Android phone
129129

130-
The table table shows the measurements (in tokens per second) measured on a Vivo X300 Android phone:
131-
132-
| LLM Framework | Model | Without SME2 | With SME2 | Uplift |
133-
|-------------------|-------------------------------------------|----------------|-----------|---------|
134-
| mnn | llama-3.2-1B | 187.06 | 334.57 | 78.87% |
135-
| | qwen25vl-3b | 73.5 | 132.46 | 80.22% |
130+
The table table shows the measurements taken on a Vivo X300 Android phone:
136131

132+
| LLM Framework | Model | Without SME2 | With SME2 | Uplift |
133+
|-------------------|-----------------------|----------------|-----------|----------|
134+
| mnn | llama-3.2-1B | 187.06 | 334.57 | 78.87 % |
135+
| | qwen25vl-3b | 73.49 | 124.56 | 69.49 % |
137136

138137

139138
{{% notice Note %}}
140139
The Android system enforces throttling, so your own results may vary slightly.
141140
{{% /notice %}}
142141

143-
As shown, SME2 brings a dramatic performance improvement.
142+
These measurements show how fast the model processes (encodes) 128 input tokens when running on a single CPU thread. As the results illustrate, SME2 delivers a significant performance boost even when using just one CPU core on an Android phone, meaning faster processing without needing to involve multiple CPU cores.
144143

0 commit comments

Comments
 (0)