Legally, the right to publish pseudonymously is part of the "moral rights" of the author. This does not necessarily expire the same as copyright expire. I believe in some countries moral rights never expire.

Moral rights means for example you can freely publish Shakespeare (because copyright is expired) but you cannot remove his name as author - he still have the right of attribution.