My in-laws live near but outside of a community that has been vacation homes for the 0.5% for over a century. Those homes never go "on the market". The owners will quietly put the word out and a year later someone new is spending a month of their summer there.

It used to be industrial powerhouse families. Today, it is more likely to be a hedge fund manager.