I think the problem is not meritocracy but an idea that you can assign each person a number that is sum of their contributions to the world and that number can be roughly estimated. Then what follows is simplistic view that worth is a one dimensional thing and you can use < operator to compare people's worth. And this is childish, unnecessary and harmful.