You can't control every factor. Arguing for "equality of opportunity" really just means taking a laissez-faire attitude as to who succeeds. It means not making explicit exclusionary rules as to who can participate, but also not undertaking a vain attempt to equalize every conceivable variable.