There is no mystery here. The majority has the physical power to force the minority to do what they want (at least if the difference is big enough). This is an objective, measurable power, not some theoretical concept or moral right. It's not magical, it very much comes from physical laws, like fists and clubs.