Running LLMs on a local mobile device doesn't make sense to me. Sure it sounds great but at what cost & what trade-offs? This goes for laptops & phones.

You can have the best of both worlds by setting up a separate computer in your local network or rent one on the cloud if data privacy & messing around with LLMs is important to you. Then you don't sacrifice the mobile advantage of a great laptop. It'll be cheaper & can be more focused too.