Skin color involves only a few genes, which don't likely impact much else. It's pretty common now for people with different skin colors to discover that they're actually rather closely related. As in maybe only second or third cousins.