Private LLM - Lokaler KI-Chat

…peccato che non si riesca ad interagire vocalmente (credo che funzioni solo se si sceglie la lingua inglese USA ,per il resto sembra carino

there are improvements that would add massive value: 1. it would be even better if it would offer the ability to have multiple chats. Having a single chat stream is confusing. On my Mac I am using LM Studio and I would love for a similar setup to be present. 2. I’m not sure it offers the maximum quantization that would be possible on the M4 16GB iPad Pro given the Q3 limits on Mistral Instruct and 4bit Phi3. I understand why those make a lot of sense for broad support in a one size fits all situation but I would naturally also like to use the device to its limits :)

This is an amazing app. Love it, I would really love a way to upload documents, offline so I can ask questions when I’m out and about. I would love to chart out my record collection to remember what I have and to cross reference serial numbers. I would like something where I can upload health documents and not worried about being profiled on google. Having a chattable document or database or however its handle is %100 what users need (imo) and just not being given by any of the 100+ chat apps. They all talk, they all generate pictures (or aspire too) no backdoor I’ll please. Just something easy.

See title

I really hope that this app can support the network search function, so that I can have a real intelligent assistant.

Have had the Private LLM app a few weeks and have enjoyed putting my new Mac mini M4 Pro to the test with a lot of the LLMs. So far so good. Everything is on local ssd but may try and experiment with it on my TB 4 DAS or even my older NAS. Will try and keep Private LLM itself on my local and move just the data to my NAS or DAS. Mac OS infrastructure keeps what I need in a well known path and folder so I’m going to experiment. Just need to figure out where to change to new Data/Folder path. Dev(s) Thank you for such a great app.

Fantastic app, I like the selection of models and they run great on the M4 chip of the iPhone 16 Max and iPad Pro. System prompt is also great for some tweaks to responses. The most simple and important feature (aside from model memory) that Private LLM needs is to be able to edit the responses of the AI. I enjoy the chatbot's responses but hate that it'll pull context from previous responses and loop entire phrases regardless if I regenerate its response or edit mine. Sometimes I don't like how the model formatted its response and want to change it without clearing the convo and retrying multiple times. The second feature that would be a quality of life is to be able to save conversations within the app. At the very least, export them as a whole without needing to screenshot, grab text, paste, correct, and format it elsewhere. I learned early on that copying text blocks at a time can cause the app to reload its model and even clear the conversation. A bot refresh would also be nice to clear older message context during a longer conversation to keep the model fast and responsive, but that can coincide with model memory to more easily pull specific facts you want it to remember in the first place without having to create a queue of explanations to pick up where you left off at. Useful if you switch models for different purposes like organizing, summarizing, q&a vs. generation, editing, brainstorming, vs. chatting.

Private LLM delivers exactly what it promises, and for $10, it’s a great deal. The app works seamlessly, and it’s worth every penny if you’re looking for a reliable, private AI assistant on your mobile device. However, as a writer, I’ve found its capabilities somewhat limited. While it excels in many areas, the nuances required to truly make language pop—metaphors, tone shifts, and narrative flair—are a challenge for any mobile AI app. The constraints of running on-device mean it’s capped at 8 billion parameters, which, while impressive for mobile, can’t compete with the richer, more nuanced capabilities of models like ChatGPT with its trillion parameters. That said, if you’re not relying on it for deep creative work, this app is a standout performer. For privacy, portability, and general utility, it’s one of the best out there. Just keep in mind its inherent limitations for high-level writing tasks. This version keeps your key points but polishes the tone and structure for better flow and impact.

I was asking the bots questions about the local processing of my conversations and it said that it actually sent it all to servers. I downloaded the app because it said it doesn’t leave the phone but then it tells me that it does… not very cool

I think there should be a history for previous chats. Maybe auto delete at one week.