Whenever I hear that "quantum computers will forever be specialized processors" I think that at how we must've thought about the very first computers, which were only really good at doing math calculations. Even GPUs have gotten way more general-purpose than what we thought they could achieve even 2 decades ago.

I think that if quantum computers become mainstream enough we'll find ways to use them for more general-purpose stuff.