Having a European passport entitles citizens to a lot of benefits globally too, but oddly enough I haven't paid taxes to any EU country since the day I moved out and nobody expects me to.

I'm not sure why the US thinks it is so special that it is entitled to tax people who happen to be born there even if they have nothing to do with the country any more. You aren't taking a loan on taxes during your childhood; that period is sponsored by everyone else. It goes both ways.