Someone else in Bangladesh didn't do shit for their kids, and their kids are still there. Was that bad luck for the kid? Yeah, but for the dad, he could have done something about it. Pure cosmic chance that you were born to dad A instead of dad B didn't negate the fact that somebody's hard work paid off and someone was there to reap the benefit that happened to be you.
Sure there is still a level of unfairness in this, it's not purely hard work. But how much unfairness do you want to really address? Dad C is a Yanomamo indian in the Amazon basin. He worked his ass off twice as hard, but his son is never going to end up in America working a high tech job. Does anybody care about addressing this inequality? Hundreds of generations of Yanomamo, and they still wear leaves and live in the jungle. Hard work alone won't get you out of that. They never built a system that lets you build on the work of others. Bangladesh did, America did, and here you are. People worked hard to get you here. It wasn't luck, _except_ for you.