Private LLM - Local AI Chat

The App is great but have had issues with many of the models giving strange and unusable responses.

iPhone 15 Pro gets stuck everytime if you navigate from the app while downloading a model. Cannot even use anything. Was eager to replace ChatGPT but it's not consistent.

This is a great, easy starting point to explore open LLMs locally on Apple devices. Unfortunately the Shortcuts integration, likely the most helpful and distinguishing feature, suffers from glitches: - The „ ask Private LLM” action errors out complaining of missing „q” and „s” parameters every second time, despite the input is one single text field - the „Start a new chat with Private LLM” action doesn’t pass the values for prompt and query to the app most often than not, I originally thought it was due to some unexpected special characters or the text being too long, but copy/pasting the same prompt and input directly in the app always works without issues Also, one missing feature that would make a world of difference since each model is tailored to specific use cases: allow pre-selecting a model for the Shortcuts actions. If the issues with Shortcuts were to be addressed, this would be easily a 5 stars app that any LLM enthusiast with not much time on their hands should by yesterday!

Works out of the box. I like that it’s getting updated with llms that will work on your phone. I would recommend to follow the developers recommendation for which LLM to use. Ps phone does warm up and use battery, but that’s expected.

The app seems more stable than the others I’ve tried. It would be good to see the ability to browse and add models from huggingface and to have RAG available document querying.

When I first tried this app, it was a letdown - just one slow option and I wasn't impressed. But man, was I wrong! The developer has put in some serious hard work, pulling off a 'No Man’s Sky' style transformation. Now, it's packed with well performing models for whichever device you have presently, and honestly it’s become my go-to. Also, I will always appreciate and recommend this app based on its privacy oriented USP alone - because finding apps that care about privacy (especially in a field so ripe for exploit) feels like panning for gold in a septic tank. I’ve gone from regretting my purchase to relying on it daily. It’s versatile, reliable, and an absolute game-changer for anyone looking to work with LLMs privately. I've got to give a huge shoutout to the developers for their commitment to turning things around. Your hard work hasn’t gone unnoticed, and I'm sincerely grateful for it. Wishing you all the success in the future - you’ve got a fan in me! Had to update my review to give the devs a huge thumbs up for such an impressive turnaround!

After I saw the only review here on the App Store that’s nothing but gibberish, I had to write my own. I love that this app works offline and everything you put into it is private and kept on your device. Plus, there’s no money hungry subscription service. From what I’ve seen on reddit, the developer is working hard on improving the app and I’m looking forward to seeing what’s implemented in the coming updates. So far it’s been great for every day questions and information.

I'm astounded that I can run such capable models on my laptop. The developer is very active and constantly improving the app. It makes running local private models extremely easy and as of the latest update has a great range of different models to chose from. I have replaced a decent portion of my Open AI usage with this App

asked it english word meanings and it failed

This is an amazing app. Love it, I would really love a way to upload documents, offline so I can ask questions when I’m out and about. I would love to chart out my record collection to remember what I have and to cross reference serial numbers. I would like something where I can upload health documents and not worried about being profiled on google. Having a chattable document or database or however its handle is %100 what users need (imo) and just not being given by any of the 100+ chat apps. They all talk, they all generate pictures (or aspire too) no backdoor I’ll please. Just something easy.