It's worth noting that many institutions you would not have thought of as "men's colleges" per se were indeed all male -- Caltech didn't admit women as undergrads until 1970.