> I certainly does not work as hard as the cleaning lady getting up at 5 am to clean my desk
No kidding. I was in the office at 10 pm the other night, and the cleaning guy came around to empty the trash cans. He's like "man, still here at 10?" And I'm thinking "well so are you."
Hard work == success, is probably a variation of the just world bias [0]. It provides a reassuring and motivating narrative, but in the end, it is quite simplistic. I am not saying that hard work is not a necessary condition, but it is far from being sufficient.
Another example : with all the discussions about European debt, it has been reported multiple times that on average Greeks were working much longer that Germans. It does not do them much good.
[0] http://en.wikipedia.org/wiki/Just-world_hypothesis