Surely a man would say that abortion is not a problem at the macro level and only impact 5% of the population.

Doesn't impact you so of course you don't care, but it does impact a lot more than 5%. Same for race relations, lots of people having to spend their life being put all kind of barriers in front of them.