Similar things apply to e.g. Amateur Radio. We've given people a big chunk of spectrum, and in exchange we expect transparency on what it's being used for. With few planes being owned by individuals, the case should be even stronger for aeroplanes, since the privacy argument applies less.
It makes you a target for doxing and swatting, and causes an unending amount of spam mail that you can't unsubscribe from.
It made sense in the older days when people routinely mailed paper QSL cards. The FCC also relies on amateur radio operators to self-police each other, which is relatively unique as far as enforcement goes (see: ARRL official observers - but even in that case, if you do something sufficiently wrong then the FCC will get involved and could look up your address).
On the other hand... QSL cards are pretty cool.
That might be a thing when self driving cars proliferate.
Second, just because an airplane is over your building, doesn't mean it's going to crash into it. Even in an emergency, airplanes can keep gliding. A car is more likely to hit you while you're on the sidewalk - does that mean you get to know the name and address of every person driving local streets?
Third, I don't see how pollution has anything to do with privacy.
I can see an argument for being able to report an airplane doing something unsafe. But that's literally what the FAA exists for, and they have ways to look up who's flying an aircraft — anonymous or not. I don't see a good argument to releasing owners' names and addresses publicly so people can do law enforcement themselves.