Introducing Offline Chat, the next-generation AI ChatBot that runs entirely on your device without the Internet. You can use it anywhere, and your data stays private and secure.
In addition to asking general questions, you can also load your private documents and ask questions about their content. It's a great way to conduct research using sensitive material. Currently we support PDF and plain text files.
We provide 3 models: Tiny, Small and Medium. A larger model gives better answers, but it runs slower and requires more capable devices. "Tiny" runs on almost all devices. "Small" requires iPhone 14 and 15 Pros and "Medium" needs Macs and high-end iPads.
While Offline Chat might not match the prowess of top-tier online models due to inherent memory and processing constraints, it stands out as an engaging and versatile tool. It's perfect for sparking creativity and assisting in various tasks such as writing, though it's advisable to verify facts independently.
For the technically oriented, "Tiny" model is based on Microsoft Phi 2, and "Small" and "Medium" models are based on Mistral 7B 0.2, quantized to 3-bits and 4-bits respectively.
Hide..Show more..
Screenshots
User Rating
5 out of 5
1 ratings
in Hong Kong
5 star
1
4 star
0
3 star
0
2 star
0
1 star
0
Ratings History
Reviews
Great app, works well
I tried to run this app on iPhone 14 Pro and the phone got incredibly hot and laggy. The app completed the task, but it also consumed lots of battery. The issue is not about the app, it’s all about iPhone. In my opinion, iPhones need at least 8 GB ram and a bigger battery to run these kind of on-device generative AI apps. I’m sure it will work better on upcoming iPhones. Thanks for developing this app!