If one has a moral compass centred on humanist values, I can’t see how such a thing as this chatbot would convince you to abandon your values. If you lack such values in the first place, then it’s just another signal among the many prevalent signals that reinforce existing beliefs.

The problem isn’t this chatbot; it’s the humans that are willing to accept nonsense about pre-ordained castes in which to classify and exclude their fellow humans.