> Another possibility is that ML researchers figure out some ways to radically reduce the amount of compute required for good training and inference on _less_ specialized hardware

just like the creation of radically simpler internal combustion engines led to us spending a lot less on internal combustion engines, right? /s