LLM Farm
Run LLM
#1 Keyword Rankings
Today
Top 10 Rankings
Today
Top 30 Rankings
Today
Top 100 Rankings
Today

Description

LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.

# Features
* Various inferences
* Various sampling methods
* Metal
* Model setting templates
* LoRA adapters support
* LoRA FineTune and Export

# Inferences
* LLaMA
* GPTNeoX
* Replit
* GPT2 + Cerebras
* Starcoder(Santacoder)
* RWKV (20B tokenizer)
* Falcon
* MPT
* Bloom
* StableLM-3b-4e1t
* Qwen
* Gemma
* Phi
* Mamba
* Others

# Multimodal
* LLaVA 1.5 models
* Obsidian
* MobileVLM 1.7B/3B models

Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.

Sampling methods
* Temperature (temp, tok-k, top-p)
* Tail Free Sampling (TFS)
* Locally Typical Sampling
* Mirostat
* Greedy
* Grammar (dont work with GGJTv3)
Hide.. Show more..

Screenshots

User Rating

4.45 out of 5

20 ratings in United States

5 star
14
4 star
3
3 star
2
2 star
0
1 star
1

Ratings History

Reviews

Application Crashed

Demaio86 on

The app keeps crashing every time i send the first message “hi” it do crash without any respond

AI

houseofcortez on

Tons of AI fun…great app

Best LLM app available

hackerlocal.us on

The app need Markdown for LLM responses. Often time the LLM will output in markdown but the app doesn’t parse it. Other then that, this is the best LLM app for mobile! It has a lot of customizable settings and it supports a lot of quantized models. It also supports all the shortcuts. What other open source LLM app can compete with this? Its developer is active and constantly trying to improved the app. I love this app.

Impressive start.

takemusuaiki on

Love this app. Surprisingly powerful and has tons of tweaking options that many apps on full computers lack. I use it on phone and iPad. I would love to see support for newer Gemma models and the ability act as an inference server like ollama or LM studio so I can run local inference for Obsidian or other apps.

So far best app for LLM

Carslov on

iOS equivalent of draw things for LLM and not stable diffusion. Would love more settings tho and integration to the neural engine ect. And get the actual training to work

Looks promising

Feeling defrauded on

This app looks pretty promising, but it’s a little bit daunting to someone who’s not as familiar with setting up LLMs. For example, how do you download the LLMs and where do you go to get them? Which alarms are likely to work? It might be a good idea to include specific LLMs that have been tested on which devices. Some sort of tutorial or instructions would be really useful.

App only needs shortcut integrations

hackerlocal.us on

This is one of the best LLM apps for mobile! It has a lot of customizable settings and it supports a lot of quantized models. It also supports all the quantized models. Shortcut integration is all this amazing app needs please great developer add app intents to the app!

Unpolished but works well (READ ENTIRE REVIEW BEFORE INSTALLING)

dragoncoder047 on

I downloaded this app as an alternative to being forced to sign up for an OpenAI account to get ChatGPT. After trying a few models and finding one I liked (LLaMA2-7B) I was quite impressed as it was my first time trying this sort of large language model. The first-launch flow could be improved. When I first opened this app I kind of expected some models pre installed and was disappointed that I had to download some from the app’s website. If models can’t be included in the app due to the file size, at least it would be nice to have a get- started prompt show up when no models are loaded, such as “Welcome to LLM Farm. To get started, you’ll need to download a model…” Also, once you have models imported and configured, it would be nice to also have a “quick start” option when starting a new chat that would let you just duplicate the model and parameters of an existing chat (but with zero history), instead of always having to go through the rather complicated setup menu as it is right now. Although the “LLaMA2 Chat 7B NEW” settings template really helps!! Some performance issues: when the model is started, it momentarily freezes my entire device (iPhone 15) — can’t type on keyboard, can’t open the control center, can’t go to Home Screen — for about 5 seconds, and then while the model is running and producing output it causes any other background tasks running such as playing music to glitch out and sometimes crash completely. (App Store readers: this just goes to show you how much computing power these models take!) it would be helpful if there was a toggle to put the model in a “throttled” mode where it runs slower to try and allow other things to run at the same time, and additionally when the model is in throttled mode it will allow the model to run in the background while you use other apps and you get a notification when the model completes its output. I don’t know much about how LLMs operate, but if this is physically possible I would really appreciate it being added.

Kind of works

LocoDubz on

Really needs some documentation on what it thinks it’s doing at times. And the fine-tune needs fixing

Good, but not the best

Shinji Aoba on

It’s really cool that you can run an LLM directly on your iPhone, but one feature I would like to see is to set a configuration that you use for all future chats, as doing it manually is too tedious to ask it something it simple.

Store Rankings

Ranking History

Category Rankings

Chart
Category
Rank
Top Free
26
Top Free
32
Top Free
40
Top Free
42
Top Free
47

Keywords

Users may also like

Name
Blueterminal
Bluetooth Terminal
Jellycuts
Supercharge your Shortcuts
Easy CSV Editor Mobile
Elegant & powerful CSV editor
Server: Host Files Locally
RegEx Tool
Learn Regular Expressions!
Changes for Linear
Native linear.app client
N/A/
N/A/
Source Files - Git Storage
for GitHub, GitLab & BitBucket
AWS IoT Sensors
Enchanted LLM
Chat with your private LLM
Show More

Revenue and Downloads

Gain valuable insights into LLM Farm performance with our analytics. Sign up now to access downloads, revenue, and more.

App Info

Publisher
Artem Savkin
Languages
English
Recent version
1.3.0 (3 weeks ago )
Released on
Dec 13, 2023 (7 months ago )
Last updated
1 week ago