I agree, these models are going to get smaller and more performant, the software to leverage your hardware is going to have major improvements, the hardware is going to change to prioritize processing these with more memory to specific coprocessors, and the OS is going to start having these models baked into them, with improved default models being a core feature of upgrading each OS version

people are looking at an extremely limited view of “bigger models on better hardware will always be in the cloud” when that reality simply won’t matter for most use cases