MLC Chat

Very cool for a demonstrator getting around 9 tokens per second. I’m sure this will be good in a plane. Would be great to be able to change the system prompt for briefer answers !

Absolutely love that Mistral came pre-installed, and that the app runs offline without a single issue, it’s awesome to have true LLM AI running locally on an iPhone 15, extremely fast inference, bravo to the dev. It would, however; be nice if the system message could be changed, or even better, you could allow users to create their own “profiles” of personality for different use cases (coding advice, verbose chatting or concise chatting, role play, etc).

Wish it had features like history and saving etc like a chatgpt app

Can the developer comment on if the testflight version records data or is no data collected on either version?

The app works well, but the instructions on how to upload other models is unclear, leaving me to only use Mistral and nothing else.

Love this proof of concept. The UI could be improved but it’s hard to complain about a free, mind blowing app like this

I really love the app! I tried all the models but all of them kept crashing. Maybe I didn’t set it right? Anyone can help? Thank you!

This app really shouldn't be made available on iPhone XS. The Mistral and Llama models fail to initialize due to insufficient memory, and the RedPajama model will initialize but crash the app every time you try to use it. So it's completely unusable on an XS, and you have to download many GBs of models to discover that.

It doesn’t work at all in n my iPhone 13. It just closes app when I hit send.

This app is barebones but the newly added Mistral model is amazing for something running locally on an iPhone. The app is barebones though and it would be nice to be able to edit the system prompt and responses.