Generally speaking, we're not trying to reduce random factors. We're trying to reduce hereditary factors. There are already plenty of intrinsic hereditary factors (intelligence, appearance, health). We want to limit the ability of extrinsic hereditary factors (wealth, connections) to influence egalitarian processes, and in some cases even correct for them.