There are also social issues, is a one stall / one urinal a single occupancy or not? Technically there's two holes.
Also you'd be surprised architecturally how many are precisely arranged such that a strategically located adjacent closet could be sacrificed to double or triple the bathroom size at a later date, if it because necessary.
(edited to add, if you assume the massively dominant cis, the labeling is to prevent office romance trysts, along the lines of joining the mile high club on a plane but without the plane)
And before anyone mentions cleanliness, my anecdotal experience (from experiences like the Starbucks) is that both men and women's toilets are dirty at about the same rate. I would love a janitor to give their observations :)
P.S.: While not what I was looking for, I was able to find this Reason article that talks about the issue: http://reason.com/archives/2014/04/11/gender-neutral-bathroo...