Commit 39cd25d
committed
Update base for Update on "[Executorch][LLM] Use caching allocator for runner"
We observed that on iOS it improves perf by 6% because SDPA op does temp allocations.
No significant difference on android though.
Differential Revision: [D86120038](https://our.internmc.facebook.com/intern/diff/D86120038/)
[ghstack-poisoned]1 parent a4912c5 commit 39cd25d
1 file changed
Lines changed: 2 additions & 6 deletions
Lines changed: 2 additions & 6 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
330 | 330 | | |
331 | 331 | | |
332 | 332 | | |
333 | | - | |
334 | | - | |
335 | | - | |
336 | | - | |
337 | | - | |
338 | | - | |
| 333 | + | |
| 334 | + | |
339 | 335 | | |
340 | 336 | | |
341 | 337 | | |
| |||
0 commit comments