Society is not as monolithic as you think it is. "as a society we" for sure have not decided that these words should not be used or that they are derogatory. Maybe this is true for your circle of friends or for the communities that you enage in but it is not true for the wider world.