$11M is net worth, not all of which needs to be held in residential real estate. I would expect a lot of people in that ballpark of net worth to probably "only" have a few million sunk into real property. The rest would likely be in securities.

Also consider that someone with 5 houses may not even have all that much of their net worth in the houses; the could largely be financed.