The possibility that good-enough quantum computers might not be possible, is just an additional argument for not replacing the current key exchange methods with post-quantum methods, but at most only with hybrid methods, which retain at least one method for which there exists reasonable trust.