Ultimately it's an empirical question, and unless someone has published the research, you and I will not be able to know for sure. I think there will be a lot of cases where two people simply look a lot alike, and any observer would have difficulty distinguishing them.