It's not that big a problem. You can let everyone designate one primary residence, and exempt the first $X of asserted value from taxation. People are entitled some sentimentality exemption, but (like today) not an unbounded one.