Saying thanks to Alexa even when you know she’s not a person is not a sign of (lack of) intelligence. It’s a sign of manners. Don’t pat yourself on the back and say you’re intelligent because you express good manners less often than the next person.

While I think it’s a bit silly that the researcher thought the chat bot was sentient, I don’t think it’s silly that the bot is perceived sufficiently human to be worth of manners if Alexa has been there for almost a decade.

I don’t think we should teach people that bots are explicitly not worth a level of manners even at the cost of a strange life-like sympathy some may develop. It took us hundreds of years to teach people that human slavery was wrong and we should treat actual people with respect - and many are still pretty bad at it. Frankly society needs all the practice it can get.

Society makes a ton of “factual mistakes”. Look at all of religion, most of politics, a huge amount of history books, much of lower-grade science education. It’s all full of “factual mistakes” that, today, probably have higher social costs than someone being nice to a robot.

What would “training” even look like? Mandatory bot-sympathizing “reeducation” classes in elementary school? We couldn’t even teach people vaccines were safe and worth getting during a pandemic, but we’re going to trying to tell people not be be nice to human-like things? I can’t imagine how high the social costs to that will be.