It's likely similar to that bias where attractive people also progress faster in jobs. Even if you're not personally attracted to them, you still have that bias.