Private LLM - Lokale AI Chat

Can you add an endpoint to make it work with Pythonista app

Incredibly useful, works great.

These models are connected to the internet whenever they can. There is nothing private about this app. Yeah sure, you can use it if you don't have internet, but when you have it, it will use it. And that is not what a private LLM app stands for.

This is a very basic interface for a completely local LLM. It uses either a 3B or a 7B Llama model depending on your device, no other models are available (yet). It support family sharing which is nice, and also runs on your Mac. On my iPhone 14 it’s reasonable quick to load and answer. For €10 it’s an ok deal if you just need basic LLM features like wrangling text. In most respects these models do not come close to ChatGPT 4 though.

I recently purchased the Private LLM app with high expectations, but my experience was extremely disappointing. The app simply does not function as it should. I tried to tell the app that its name was James, but instead, the app argued with me that I was James. These kinds of inaccuracies make the app unusable and frustrating. At the moment, I honestly cannot recommend using Private LLM, given the issues I have encountered. I sincerely hope that future updates will address these issues. If the app is updated and these problems are fixed, it might have potential. Until then, unfortunately, I don't feel like I'm getting value for my money.

This is an amazing app. Love it, I would really love a way to upload documents, offline so I can ask questions when I’m out and about. I would love to chart out my record collection to remember what I have and to cross reference serial numbers. I would like something where I can upload health documents and not worried about being profiled on google. Having a chattable document or database or however its handle is %100 what users need (imo) and just not being given by any of the 100+ chat apps. They all talk, they all generate pictures (or aspire too) no backdoor I’ll please. Just something easy.

See title

I really hope that this app can support the network search function, so that I can have a real intelligent assistant.

Have had the Private LLM app a few weeks and have enjoyed putting my new Mac mini M4 Pro to the test with a lot of the LLMs. So far so good. Everything is on local ssd but may try and experiment with it on my TB 4 DAS or even my older NAS. Will try and keep Private LLM itself on my local and move just the data to my NAS or DAS. Mac OS infrastructure keeps what I need in a well known path and folder so I’m going to experiment. Just need to figure out where to change to new Data/Folder path. Dev(s) Thank you for such a great app.

Fantastic app, I like the selection of models and they run great on the M4 chip of the iPhone 16 Max and iPad Pro. System prompt is also great for some tweaks to responses. The most simple and important feature (aside from model memory) that Private LLM needs is to be able to edit the responses of the AI. I enjoy the chatbot's responses but hate that it'll pull context from previous responses and loop entire phrases regardless if I regenerate its response or edit mine. Sometimes I don't like how the model formatted its response and want to change it without clearing the convo and retrying multiple times. The second feature that would be a quality of life is to be able to save conversations within the app. At the very least, export them as a whole without needing to screenshot, grab text, paste, correct, and format it elsewhere. I learned early on that copying text blocks at a time can cause the app to reload its model and even clear the conversation. A bot refresh would also be nice to clear older message context during a longer conversation to keep the model fast and responsive, but that can coincide with model memory to more easily pull specific facts you want it to remember in the first place without having to create a queue of explanations to pick up where you left off at. Useful if you switch models for different purposes like organizing, summarizing, q&a vs. generation, editing, brainstorming, vs. chatting.