So Moore's Law is a constraint for average people as hardware costs a key factor in performance, is that right?

What I'm saying is the hardware is less of a problem than access to data, for most problems that would get you out of what you can reasonably do on a consumer accessible (cost) machine.

Unless we have widely available pre-trained models with generic knowledge that is easily transferable. Such a thing is obviously difficult, but it isn't impossible if we're talking about the future.