Patagonia AI - Private LLM

App is well designed. Beyond that, it needs a ton of work. It generates text slowly and is extremely biased and politically correct to a nauseating extent. I would love to be able to use my own choice of LLM rather than being stuck with whatever is being forced on users.

“Sorry, your device cannot provide 3788.8MB Memory as requested to the app, so we cannot initialize this model on this device. Please try on a newer device” Using IPhone 12 Mini chat gpt and both perplexity along with others work. Hmm but indeed those devices primely don’t run locally offline on devices.

I love the respect for private and secure use that this app is built on. Just a couple things I’d like to see improved: When receiving a response, text comes in one word at a time, very slowly. Often, responses are left incomplete. Once improved, I will update my review. Thank you for your efforts!

I will preface this review with stating this is is free and collects zero user data so any ideas I have could be improved with future update. The overall interface is really good. It’s super simple with nothing more than what is needed for chatting with a llm on device. It follow design notes of even the open ai ChatGPT app with suggested prompts and a clean input and well formatted chat dialog interfaces. The icon and name and branding are just simple clean and great all around. The speech to text feature is nice and stable. It doesn’t detect when you stop speaking but I’d argue that’s more accessible for if you pause to think mid way through your question. The simple use of color is also nice. Now for the areas to improve. The app description claims that it is a fully open source project but I cannot find an app by this branding anywhere online on public code hosting sites like GitHub or Gitlab. Also the app listing website or app support go to a website that has no contact information or even a mention of this app at all. It’s an outdated manifest predicting what advancements apple may roll out in 2022. It’s 2024, at least follow apples guidelines and provide some contact information on your support website so end users can get ahold of the developer if needed. This brings up concerns of the credibility of the developer claiming no data collected and claiming the app is completely open source. Maybe the description meant the llm model used on devices is open source? I’m not sure I’ll ever know which. Other areas for improvement would be a text to speech option for the llm responses so you could optionally hear the response. iOS has a great built in TTS frameworks that work offline too. The main issue with this app in its current form is just how slow it is at typing the response from the LLM. I know some LLMs are slower that others on an iPhone but I have other offline LLM apps that run circles around how slow this app is at relaying the response. I’m not sure why it’s so slow? Maybe a artificial delay introduces from a poorly written animation? Or the model included in the app is not as optimized as some of the other open source models used in other apps. I was kind of thinking of making a pull request to at least add TTS and maybe fix the slow response output but without a public git repo I simply cannot help. Hopefully you can fix these concerns in a future update even if you keep your source code private. That’s fine too. It’s

For running on an iPhone this app works wonders being able to converse with artificial intelligence without the Internet is really some special. I’m really happy that these developers decided to make this more accessible and share this app for free I would 100% recommend downloading this app one of the coolest technologies I’ve ever seen and I hope, they keep improving it. Thank you for creating something truly amazing!!

This AI is able to answer things quickly and well and at the same time doesn’t have the caveat of storing all of your queries or gathering your data. So far the answers have been high-quality and thorough without the need to connect online, which is impressive.