I'm also reasonably sure other factors also influence these algorithms. Hair style, framing, lighting, the clothes found on your shoulders, angle, distortion by the camera lens, and most importantly, similarity to high-scoring faces in the source data set.