When people say "he's rich, it wasn't a risk for him" they're really saying that the person wasn't risking their well-being. They're not saying that person didn't risk something else, such as employability; but employability is unimportant to someone in that position whilst for another person it's vital.

So yes, technically you're right, but your argument is missing the vital essence of what people mean when they say, eg, "Bill Gates wasnt taking a risk".