Commit e5a8645
committed
Fix LlamaDemo default temperature, lifecycle cleanup, and LLM memory support
- Change DEFAULT_TEMPERATURE from 0.0 to 0.6 to prevent greedy decoding
from hitting EOS token immediately on first generated token
- Add onCleared() lifecycle handler to ChatViewModel for proper Module
resource cleanup when ViewModel is destroyed
- Update fbjni to 0.7.0 for main_exp AAR compatibility
- Enable largeHeap in AndroidManifest for large LLM model support
Authored with Claude.1 parent c947b03 commit e5a8645
4 files changed
Lines changed: 10 additions & 2 deletions
File tree
- llm/android/LlamaDemo/app
- src/main
- java/com/example/executorchllamademo
- ui/viewmodel
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
268 | 268 | | |
269 | 269 | | |
270 | 270 | | |
271 | | - | |
| 271 | + | |
272 | 272 | | |
273 | 273 | | |
274 | 274 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
| 15 | + | |
15 | 16 | | |
16 | 17 | | |
17 | 18 | | |
| |||
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
153 | 153 | | |
154 | 154 | | |
155 | 155 | | |
156 | | - | |
| 156 | + | |
157 | 157 | | |
158 | 158 | | |
159 | 159 | | |
| |||
Lines changed: 7 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
96 | 96 | | |
97 | 97 | | |
98 | 98 | | |
| 99 | + | |
| 100 | + | |
| 101 | + | |
| 102 | + | |
| 103 | + | |
| 104 | + | |
| 105 | + | |
99 | 106 | | |
100 | 107 | | |
101 | 108 | | |
| |||
0 commit comments