I'm pretty sure that exit tax is for citizens only. They'll have a hard time tracking down non-citizens and no leverage, except for threatening to revoke the green card and/or restrict entry into the US.
The marriage thing is a very good point.
One difference is if you marry a non U.S. woman. then you need to put her on waiting list for 5 years before she can come to U.S. because you are only a permanent resident. But since you have paid millions of taxes. I guess you are rich enough if this happens to do things in alternative way such as EB-5 for her.