Lots of rich people become poor as well, maybe its just that few people see a celebrity or multimillionaire going bankrupt and disappearing from the public view or their decedents blowing their inherited money on designer goods, cars, gambling alcohol or an expensive spouse who loves them for their money as particularly notable.

"from rags to rags in three generations" etc...