Skip to content

v0.5.7

Choose a tag to compare

@jakmro jakmro released this 01 Oct 15:16

What's Changed

  • Added token batching during llm inference to reduce rerenders and improve performance
  • Improved threadpool configuration on iOS significantly increasing inference speed and reducing power consumption
  • Fix SQLite bug crashing app builds when SQLite is included from other libraries

Full Changelog: v0.5.6...v0.5.7