You can think about this as a fashion thing: on one side you had people wearing all sort of clothes and weapons, on the other you have people wearing exactly the same clothes and weapons. So, while you might have a point, it's much harder to not identify the second group as an official army not showing who's leading them.