MLC Chat

Hey. just wanted to take a moment to express my heartfelt appreciation for this amazing app! Not only is it incredibly easy to use and totally free, but the developer has added new models very quickly when they’ve come out. And the latest update is a testament to that - the latest llama models from Meta are now available, and I'm thrilled to report that the llama 3.2 3B model works beautifully on my iPhone 15 Pro! Thanks again!

Would love a way to add links to models in Hugging face as long as they have been converted to MLX!

Absolutely love that Mistral came pre-installed, and that the app runs offline without a single issue, it’s awesome to have true LLM AI running locally on an iPhone 15, extremely fast inference, bravo to the dev. It would, however; be nice if the system message could be changed, or even better, you could allow users to create their own “profiles” of personality for different use cases (coding advice, verbose chatting or concise chatting, role play, etc).

Wish it had features like history and saving etc like a chatgpt app

The app is great but can you add shortcuts support?

Tried many times, the conversations cannot be saved. It’s really a nuisance! What’s the point if the conversation isn’t saved for later use? Disappointed!

The app works well, but the instructions on how to upload other models is unclear, leaving me to only use Mistral and nothing else.

Love this proof of concept. The UI could be improved but it’s hard to complain about a free, mind blowing app like this

I really love the app! I tried all the models but all of them kept crashing. Maybe I didn’t set it right? Anyone can help? Thank you!

This app really shouldn't be made available on iPhone XS. The Mistral and Llama models fail to initialize due to insufficient memory, and the RedPajama model will initialize but crash the app every time you try to use it. So it's completely unusable on an XS, and you have to download many GBs of models to discover that.