The French Foreign Legion is a famous counterexample to your argument here. They might actually have the best Esprit du Corps in the world. In particular because they have to since they are indeed comprised of random foreigners and historically at least low-level criminals.