Offense is all about context. It is objectively quite offensive when used as a term for a person. (“Objectively” works here because a word being offensive is determined by how people view it. The views are subjective but the prevalence of those view is not.)