That risk isn't about AI-as-AI. That risk is about AI-as-better-persuasive-nonsense-generator. But the same risk is there for any better-persuasive-nonsense-generator, completely independent from whether it's an AI.

It's the most persuasive actual risk I've seen so far, but it's not an AI-specific risk.