The colonialists emphasized the split for political gains, and there must have been some arbitrariness in assigning each person to exactly one category, but they certainly didn't pull the distinction out of thin air. Just look at the pictures in the infobox in their respective Wikipedia articles.