Private LLM - Local AI Chatbot

This is a very basic interface for a completely local LLM. It uses either a 3B or a 7B Llama model depending on your device, no other models are available (yet). It support family sharing which is nice, and also runs on your Mac. On my iPhone 14 it’s reasonable quick to load and answer. For €10 it’s an ok deal if you just need basic LLM features like wrangling text. In most respects these models do not come close to ChatGPT 4 though.

I recently purchased the Private LLM app with high expectations, but my experience was extremely disappointing. The app simply does not function as it should. I tried to tell the app that its name was James, but instead, the app argued with me that I was James. These kinds of inaccuracies make the app unusable and frustrating. At the moment, I honestly cannot recommend using Private LLM, given the issues I have encountered. I sincerely hope that future updates will address these issues. If the app is updated and these problems are fixed, it might have potential. Until then, unfortunately, I don't feel like I'm getting value for my money.

Here was my prompt: Request a LinkedIn recommendation from a friend who offered to do one for you. No more than 4 sentences. Tone should be very friendly and familiar and ask them to focus on these 2 things (make them placeholders), if possible. It wrote a recommendation that I would be giving for a friend, basically is not able to deduce or understand the meaning of the prompt. This happened repeatedly with prompts input. Put same prompt into ChatGPT - near perfect response. Tried a few different models including dolphin, LLama - same issues. Not sure if it’s in how to app approaches the LLM or some other factor, but it’s not as good as using ChatGPT or even Ollama on Mac.

My phone isn’t outdated as developer responded…. Default LLM is the only one that half way works but it isn’t worth it. It always states this at the end of everything. “The second paragraph is in English. 번역결과 넷, 제가 언어를 구한 2009년 3월 16일 LLM-데이터 수량을 5밀라 7밀라 8밀라 9밀라 10밀라의 요청은 "앞으로 어떻게 원하는 대지? 4단위 4단위 6단위 8단위 9단위 10 단위 11단위 12단위 13단위 14단위 15단위 17단위 18단위 19단위 20단위 22단위 24단위 27단위 28단위 29단위 30단위 등 참고해 주세요."

This app is pretty fantastic! It runs almost smoothly on my phone and I can use it anywhere without needing the cloud. Some additional features that would be cool are being able to browse the internet, interact with documents, get connected with a keyboard for rephrasing or correcting grammar on my phone instead of just on a computer. Also, there could be some improvement in user experience - smoother animations would be awesome. Keep up the good work!

Awesome app allowing you to choose which LLM’s you use for specific tasks. I think it’s pretty flawless the way it is great job on developing. I think it’s the best thing available today. Ultimate Wish list: functionality to simultaneously query multiple chosen large language models and aggregate their responses into a single answer by master LLM chosen.

On least on the high-end iPad, performance is wonderful even on the largest models. Definitely worth $10 USD.

This LLM app is what i was looking for. It is the reason I purchased an iPad M4. Defff worth the $10. Even the developer is active and available to chat with online, so reach out if you run into any issues, overall super great and cannot wait to see more updates!

I seen that there’s different AI models to choose from in the App Store pictures but when I open the app, the ones in the picture aren’t there. Maybe there could/should be an instruction page on where/how-to download other AI models

Still the best offline AI, most stable and has by far the most current datasets available; this is truly a beast of an app for offline use. I strongly recommend! 👍👍👍