That is a retrospective way to address fairness. Another is, "Given where they are, can they start doing better and end up in a better place?"
A systemic problem that can (or used to) shove people down economically could be different than a systemic problem that doesn't allow a (reasonable) way to advance once they're at the bottom.
Point being, maybe people gave up. Maybe it's their fault. Maybe there was nothing they could do about it. But it's imperative that they have credible ways to undo that decision going forward.
Relevant issues (different people will add and/or subtract from the list):
1. permanent felony records and difficulty in getting records expunged after a history of good citizenship
2. hard cut-offs in government benefit programs
2a. getting a raise should not be a personal net loss
2b. getting married should not be a personal net loss
2c. getting more hours should not be a personal net loss, for you or your employer (the ACA really messed up here)
2d. moving to a better situation should not put your benefits at risk
3. Age discrimination needs to be taken more seriously
3a. 50-year-old college grads should have the same shots as anyone else. Otherwise, retraining from failed industries will be prohibitively difficult.
3b. New grads can't afford to wait 5-10 years for their first shot... this causes delayed marriages, delayed savings for retirement, an aging workforce, etc.
4. Home addresses are tied to wealth. Public schools are tied to home addresses. So public educational opportunity for kids is tied to how much wealth their parents have. Something has to be done about this.
Shit, how have I missed the evolutionary war of all against all going on all around me? There are so many gene-rivals I could have stabbed in back-alleys!
Or does evolution maybe allow for successful strategies towards survival and reproduction that don't neatly map to metaphors about war?
Farmers that worked hard and planned ahead did better than those who did nothing. Those that bought crop insurance or fastidiously watched the weather were in a better position to succeed than those who didn't. Similar scenarios abound for your other examples.
No matter how much you wish otherwise, nature (and our society) is set up for certain kind of animals/people to succeed - and if you wilfully choose to ignore the system that's fine, but don't be mad when it doesn't work out great for you.
Here's the mistake in your thinking as a society can be set up to be fair or unfair. However, a society can be changed and does change. It's fine to be mad at unfairness, it's fine to fight unfairness via societal changes.
Unless you meant to write something completely different, that's your stance and he rebutted it
Humans have nature, too, and no amount of laws or rules will stop human nature. Until human beings become something else, always bet on it. Giving them more resources (e.g. money) tends to make things worse for them.
In the west, we're all living in rich enough countries that no one should need superhuman will or fire or tenacity simply to live a decent life. No one willing to work 40 hours a week should be denied access to the medical care system, face food or housing insecurity, etc.
The fact that that is the situation for many speaks to problems in the way we've arranged society (which is about as far from "how nature works" as possible), not some innate rightness in the world.
Quite often that's the problem. Particularly if we've built up a palace of perverse incentives that make it a better strategy to coast along on the byzantine web of social services that is effectively an inefficient Basic Income for people at the bottom of the pile, than it is to get a shitty job and make just enough money to lose all those benefits.
I can't really blame people that realize that that's the situation they face, though.
However, to give another perspective on it. When I think of changing an unequal situation, I look at the situations you described like this: "Did something happen early on in that person's life that just kind of made them give up?" I've known people like that, and although it is _also_ true that they _could_ lift themselves out of that situation, when you take it in aggregate over a large population, it becomes a problem (at least to me it does).
Why is it a problem? Well, to me it is for two main reasons. First, it gives an indication that there may be a systemic problem that could be corrected (overzealous police, poor education, a political issue, etc.). Frankly, we're far along enough as a species that there's no reason to tolerate that. Second, it means a meaningful portion of the population isn't contributing to humanity/earth/however you want to think of it in a way they otherwise could, which holds all of us back.
One of the things that makes it complex is that the answer, I think, changes a lot depending on the population.