Private LLM - Lokaler KI-Chat

I rather pay 25$ per month for CGPT and won’t have an offline version than this. Boring, slow, no NSFW (not its fault, it’s the AI-Models and CGPT won’t offer it too I know yet something which would be interesting), huge GB size … well. Sorry, not sorry.

Die App läuft flüssig, die Modelle antworten schnell. Es gibt viele Modelle zur Auswahl. Mein Vorgänger hat von Abstürzen berichtet, das kann ich nicht bestätigen. Bei mir läuft alles flüssig. Super! Die 10€ sind es auf jeden Fall Wert. Dickes Dankeschön an die Entwickler

Crashes most of the time. When it runs results are disappointing. There are more sophisticated and better working free and Open Source alternatives out there.

Works very well on iPad Pro 11‘‘ with M1 Chip. I would like to get support for more LLMs (currently only 2 are available).

This is an amazing app. Love it, I would really love a way to upload documents, offline so I can ask questions when I’m out and about. I would love to chart out my record collection to remember what I have and to cross reference serial numbers. I would like something where I can upload health documents and not worried about being profiled on google. Having a chattable document or database or however its handle is %100 what users need (imo) and just not being given by any of the 100+ chat apps. They all talk, they all generate pictures (or aspire too) no backdoor I’ll please. Just something easy.

See title

I really hope that this app can support the network search function, so that I can have a real intelligent assistant.

Have had the Private LLM app a few weeks and have enjoyed putting my new Mac mini M4 Pro to the test with a lot of the LLMs. So far so good. Everything is on local ssd but may try and experiment with it on my TB 4 DAS or even my older NAS. Will try and keep Private LLM itself on my local and move just the data to my NAS or DAS. Mac OS infrastructure keeps what I need in a well known path and folder so I’m going to experiment. Just need to figure out where to change to new Data/Folder path. Dev(s) Thank you for such a great app.

Fantastic app, I like the selection of models and they run great on the M4 chip of the iPhone 16 Max and iPad Pro. System prompt is also great for some tweaks to responses. The most simple and important feature (aside from model memory) that Private LLM needs is to be able to edit the responses of the AI. I enjoy the chatbot's responses but hate that it'll pull context from previous responses and loop entire phrases regardless if I regenerate its response or edit mine. Sometimes I don't like how the model formatted its response and want to change it without clearing the convo and retrying multiple times. The second feature that would be a quality of life is to be able to save conversations within the app. At the very least, export them as a whole without needing to screenshot, grab text, paste, correct, and format it elsewhere. I learned early on that copying text blocks at a time can cause the app to reload its model and even clear the conversation. A bot refresh would also be nice to clear older message context during a longer conversation to keep the model fast and responsive, but that can coincide with model memory to more easily pull specific facts you want it to remember in the first place without having to create a queue of explanations to pick up where you left off at. Useful if you switch models for different purposes like organizing, summarizing, q&a vs. generation, editing, brainstorming, vs. chatting.

Private LLM delivers exactly what it promises, and for $10, it’s a great deal. The app works seamlessly, and it’s worth every penny if you’re looking for a reliable, private AI assistant on your mobile device. However, as a writer, I’ve found its capabilities somewhat limited. While it excels in many areas, the nuances required to truly make language pop—metaphors, tone shifts, and narrative flair—are a challenge for any mobile AI app. The constraints of running on-device mean it’s capped at 8 billion parameters, which, while impressive for mobile, can’t compete with the richer, more nuanced capabilities of models like ChatGPT with its trillion parameters. That said, if you’re not relying on it for deep creative work, this app is a standout performer. For privacy, portability, and general utility, it’s one of the best out there. Just keep in mind its inherent limitations for high-level writing tasks. This version keeps your key points but polishes the tone and structure for better flow and impact.