Commit d83b4a9
committed
Update base for Update on "[Executorch][LLM] Use caching allocator for runner"
We observed that on iOS it improves perf by 6% because SDPA op does temp allocations.
No significant difference on android though.
Differential Revision: [D86120038](https://our.internmc.facebook.com/intern/diff/D86120038/)
[ghstack-poisoned]1 parent 0bf3b2e commit d83b4a9
0 file changed
0 commit comments