I know there's adverse selection going on, but everything I have seen from the TV programme Grand Designs tells me that this is a good way to great unhappiness and destroying your marriage.

> decided to save up $500K

For most people this is called "retirement"; by the time you've hit that total, you're over 60 and needed somewhere to live in the meantime.