You're assuming that an alien race isn't partisan. Any intelligent alien species intent on harming humans would probably seek to exploit existing weaknesses and increase division. Who's to say they wouldn't ally with the worst humans imaginable in order to prevent humanity coming together in the first place?