I'm pretty sure he just stated that both socialists and fascist want centralization of power. I'm pretty sure that's not a debatable stance. It doesn't imply that if you're a socialist then you must be fascist. That'd be a logical fallacy.

Just as if I said, "soccer moms and skin-heads both breathe air". Should soccer moms feel attacked? Am I name calling? Of course not.