Take that comment with an assumption of good intentions, and you can get to a specific situation like: "oh man, that particular guy really has nothing going for him, if he had kids it would look a whole lot different". BTW, I feel like "that guy" sometimes, and it's probably quite common.