I agree, but the argument holds --- in particular I'm thinking of Google's supremacy experiment, where they did do something that, taken as a generic process, would require resources beyond "the best available classical hardware and the best available classical algorithms of the time". However, people play catch-up, and end up coming up with classical approaches for that particular experiment. Of course, factoring is a special and very strong case that is less susceptible to this.