> I think the real ethical concern here should be that people can be idly fooled into thinking good chat bots are sentient.

I think the opposite is much more scary: that we can convince people that other people are just good chat bots. The internet is already doing a bang-up job of getting us to de-humanize one another, so that's pretty much the last thing we need.