Maybe in a few decades governments will be retroactively sued for failing to provide adequately labeled bathroom facilities for all genders?

Judging the past on the standards of the present is usually a bad idea. This doesn't excuse past misdeeds or dismiss the need for progress. The human condition is a work in progress.