It turns out most people don't organize their lives around tax policy. And in the case of US persons (citizens and GC holders) leaving the country doesn't remove the obligation to file and pay taxes.

Doubtful. Maybe they’ll move somewhere else in the US. Ie dispersing throughout the rest of the US. They’d increase demand for goods/services elsewhere and maybe real estate becomes cheaper where they left.