I think it stems from a world view that presumes any difference in outcomes must be the result of oppression, and that no other contributor could be notably relevant.