I actually expect open source models will be small _but larger than they are today_ because phones and laptops will get dedicated chips and software for running eg the best open source (weights?) model

So eventually you could be running decent sized models locally (iOS could even provide an API with fine tuning etc)