It's more complicated than that. If you've had the green card more than (I think) 8 years you will be treated like a citizen should you want to give up the residency. So you have to pay the exit taxes (mentioned somewhere else in this thread).