Even the poor don't have a meritocracy. Plenty of meritorious people have otherwise been screwed by lead paint, abusive landlords, terrible teachers, imbalanced policing, hiring bias, and more.