> vs by improving model architectures to be more efficient?

or data quality, you get more from small models if you use high quality data