it's important not to allow age-based vocab to drift when you are talking about a woman vs. a man, but I think it's more contextual than you present it. there are plenty of males over the age of eighteen whom I would not refer to as "men". if you changed only the gender of these people, I would probably not refer to them as "women" either.