> The ultimate reason for this is Moore's law, or rather its generalization of continued exponentially falling cost per unit of computation

Is it though? To me it seems like performance gains are slowing down and additional computation in AI comes mostly from insane amounts of money thrown at it.