Agreed with the overall point (small models will prove powerful) but I disagree with:

> But having more fine-tuned control over model parameters is a pattern that will emerge

This assumes parameters do something interpretable. IMO, it’s more that parameters themselves are meaningless/dumb and patterns evolve via interaction of many such units (like in ants)