You can run larger flash models on a modern PC using strata. These models perform pretty good even on low quants.

Furthermore, next generation open weight models will swap some compute for storage, making them more accessible for masses.