> I think the real ethical concern here should be that people can be idly fooled into thinking good chat bots are sentient.

people can be fooled in general for pretty much any reason. this is just a newish avenue for deception. but i don't see it as something different than getting a call from some crooks to transfer some money.