PocketPal AI

Scroll isn’t functioning correctly in a couple areas: at the Settings and when adding models from Huggingface (including the search bar)… the scroll functions correctly when selecting a model and displaying it’s available GGUFs. Only noticed this in the latest update. It’s been a really straight forward app and has been great to use. Thank you for your work on this.

I've been using this app for a couple of days now, and I have to say, running Llama 3.2 3B locally/offline on my phone has been a game-changer for my productivity. The interface is clean and easy to use. Some suggestions I have are to consider changing the typing bubble inside the chats to a darker tone when using dark mode instead of being white and I suggest a more minimalistic approach to the app icon design. I would also greatly appreciate the incorporation of some extra features to enhance the app’s functionality. For instance, AI and user response editing, feedback options for AI responses, file upload, text highlighting or voice recording capabilities would be a significant advantage. Overall, I highly recommend this app to anyone looking for a reliable way to run an AI offline on their phone.

iphone se2 ios16.5. cannot load downloaded model

This app works on my iPhone 15 but when I loaded a local model for llama 70b it doesn’t load and shows no error message. It just says “Ready to chat? Load last model used” Also, there is no way to delete previous chats Update: looks like you can delete chat by swiping right

The downloads always fail partway through regardless of which.

There’s a bug where chat goes blank when the keyboard goes down after typing and swiping down or leaving chat; I have to leave the app and load it again. Please add a bug report, feedback/suggestions option in the app and if you’re gonna add ads make it so in order to download a ai you’re required to watch one before downloading if that’s possible, If you want motivation to fix this app by making money off it, I like that there’s no tokens to buy to chat. keep adding features, if possible add the image generator and video generation, watch ad before generating if possible to avoid paying. Can you stop the chat from going down when the ai is responding it’s a nuance I want to read the top to bottom while it’s responding. Put a description of what the metal api is gonna do and what it is, for those who aren’t familiar.

Coolest app I’ve ever used. Thank you for making this. I only wish there was a bit more assistance with tinkering with all the confusing settings and more updated templates. Keep up the great work!

Thank you for making this app and for keeping it free to use! It’s got a very comfy and intuitive UI which I love, and it’s awesome being able to choose our own (gguf) models and configuring all the settings. One thing I noticed though. The EOS token is visible in the response when chatting with llama3.2 (using the default template)

It is a simple and neat product. But no way to delete or manage past messages on iPhone app. You just leave there forever?

Beautifully well executed app. The inclusion of llama3.2-3B is icing on the cake. I use chat gpt 4o and in my opinion, for the information that i need, it is almost a drop-in replacement. I do have a request though: Since llama3.2 comes in multimodal versions, will you be making an app that can leverage these new llms?