I'm about 90% certain that there are numerous huge inefficiencies in these big transformer models. Inefficiencies so big that eliminating them would make it possible to run the equivalent of the latest frontier models on your phone.

But nobody wants to look for them too hard because centralized AI as a service is where all the money is. So everybody keeps building bigger rather than smarter.