I think we agree, my point is that we're discussing two different conceptual categories and it's dangerous to use the same words for those categories when specifically arguing about only one.

One, it makes it appear that all ethical and social conventions for the one can be applied to the other and it's a done deal.

Two, it makes it appear that conclusions are also reversible, and that turns seemingly enlightened libertarian ideas into munition for racism.