> when AI systems get more common, this will be a common nightmare for regular people

I'm not sure. We've had automated phone customer service systems forever, but companies that in any way care about their customers still let you escalate to a human.