Skip to content

Commit 4dbc72b

Browse files
committed
add mnn figures for 2 threads
1 parent 67a96b6 commit 4dbc72b

1 file changed

Lines changed: 6 additions & 6 deletions

File tree

  • content/learning-paths/mobile-graphics-and-gaming/voice-assistant

content/learning-paths/mobile-graphics-and-gaming/voice-assistant/7-performance.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -123,14 +123,14 @@ The table table shows the measurements taken on a Vivo X300 Android phone:
123123

124124
| LLM Framework | Model | Threads | Without SME2 | With SME2 | Uplift |
125125
|-------------------|-----------------------|---------|----------------|-----------|----------|
126-
| mnn | llama-3.2-1B | 1 | 196 | 339 | 72.96 % |
126+
| mnn | qwen25vl-3b | 1 | 33 | 134 | 306.06 % |
127+
| | | 2 | 51 | 140 | 174.51 % |
128+
| | llama-3.2-1B | 1 | 196 | 339 | 72.96 % |
127129
| | | 2 | 275 | 396 | 44.00 % |
128-
| | qwen25vl-3b | 1 | 73.49 | 124.56 | 69.49 % |
129-
| | | 2 | | | |
130-
| llama.cpp | llama-3.2-1B | 1 | 148 | 173 | 16.89 % |
131-
| | | 2 | 124 | 191 | 54.03 % |
132-
| | qwen-2-VL | 1 | 113 | 146 | 29.20 % |
130+
| llama.cpp | qwen-2-VL | 1 | 113 | 146 | 29.20 % |
133131
| | | 2 | 92 | 139 | 51.09 % |
132+
| | llama-3.2-1B | 1 | 148 | 173 | 16.89 % |
133+
| | | 2 | 124 | 191 | 54.03 % |
134134
| | phi-2 | 1 | 58 | 77 | 32.76 % |
135135
| | | 2 | 46 | 60 | 30.43 % |
136136

0 commit comments

Comments
 (0)