Hello Flet team!
I am building a local AI agent app for Android/iOS using Flet. I rely on llama-cpp-python for running local GGUF models directly on device.
Because llama-cpp-python relies on building the llama.cpp C++ engine from source, it currently throws a missing wheel error ("No matching distribution found") during the flet build apk process since there are no pre-compiled Android/iOS wheels available on PyPI.
Package Details:
- Name: llama-cpp-python
- PyPI: https://pypi.org/project/llama-cpp-python/
- Use Case: High-performance native bindings for
llama.cpp. This is absolutely critical for allowing us to execute LLM inference directly on mobile devices, which is a strict requirement for offline/local-first AI applications.
Could we get llama-cpp-python added to the mobile forge (pypi.flet.dev) so we can run LLMs natively on Flet mobile?
Thank you!
Hello Flet team!
I am building a local AI agent app for Android/iOS using Flet. I rely on
llama-cpp-pythonfor running local GGUF models directly on device.Because
llama-cpp-pythonrelies on building thellama.cppC++ engine from source, it currently throws a missing wheel error ("No matching distribution found") during theflet build apkprocess since there are no pre-compiled Android/iOS wheels available on PyPI.Package Details:
llama.cpp. This is absolutely critical for allowing us to execute LLM inference directly on mobile devices, which is a strict requirement for offline/local-first AI applications.Could we get
llama-cpp-pythonadded to the mobile forge (pypi.flet.dev) so we can run LLMs natively on Flet mobile?Thank you!