Your comment is straight to the point, just see how fast ASICs have destroyed the idea of using graphics cards to mine crypto.

I find it very likely that we'll have in a year or two, not only cheaper but also faster hardware that can do training and inference.