LLM Farm

It's an excellent app. I hope it can add support for the Qwen large model.

This app doesn’t support VLMs though the preview image would suggest that it does. False advertising

This is great! Lots of options for running custom models. Would love to have the ability to upload images for vision models. Allowing models to perform web searches would be handy too!

Really like this app after trying it out. I can see in the preview images that can send pictures to llm, but I couldn't find the plus sign at the bottom left corner on my own phone. How does it works? The download of models will be terminated when the phone screen is off. It would be even more perfect if it could run in the background and share computing power services with other users on the local network through an API. Very good!

I think it's overall pretty good! However, I'm not a fan of the animal icons for every conversation. I believe using regular icons or even having the option to have no icon at all would attract more users to the app. Additionally, it would be great to have a "new conversation" button in the menu instead of creating a duplicate conversation each time which just made the title become longer and longer Also, maybe using AI to generate titles like ChatGPT does is great. Lastly, it would be awesome if the markdown format could be displayed during the generation process instead of after it's done. that would be awesome 👍 Anyway, thank you very much for this app!

I don’t know if it is because the settings or not, but I keep getting weird responses where it would try to respond to me only for it to suddenly change the text to random Chinese characters mid generation and stuck infinitely loading. I am running default settings btw.

The app keeps crashing every time i send the first message “hi” it do crash without any respond

Tons of AI fun…great app

The app need Markdown for LLM responses. Often time the LLM will output in markdown but the app doesn’t parse it. Other then that, this is the best LLM app for mobile! It has a lot of customizable settings and it supports a lot of quantized models. It also supports all the shortcuts. What other open source LLM app can compete with this? Its developer is active and constantly trying to improved the app. I love this app.

Love this app. Surprisingly powerful and has tons of tweaking options that many apps on full computers lack. I use it on phone and iPad. I would love to see support for newer Gemma models and the ability act as an inference server like ollama or LM studio so I can run local inference for Obsidian or other apps.