There is no reason to expect that strong AI will share the exact same feelings we do unless someone explicitly programs it to (which would be a mistake). Any truly emergent emotional behavior on the part of an AI would be very likely to differ substantially from ours. Making a chatbot "sad" is not the same as making a sapient (or even sentient) being sad. If AI ever achieves sentience, we're going to have to learn what makes it uniquely happy and sad.
Because courtesy requires some amount of empathy and mental effort on top of what's required just to communicate your point. That effort is wasted on a machine.
There is a radical view that consciousness is the fundemental unit of reality, and as such, it would not be wasted.
Then there is a particular kind of emotional attitude / posture / intent, where the something is treated as if it were sentient. It is neither cognitive or affective empathy, ao much as a shift in how things are experienced. It isn't something invoked through will. Hard to describe if you've never experienced altered consciousness states.
That particular shift is a fairly important experience for people (or at least for neurotypical), but is not obvious why to anyone who had never experience that shift. (I am speaking about neurotypical people, and some neurodovergent people, not necessarily someonr with a pauci-affective empathy neural architecture, such as people who are psychopaths).
Just thought of these:
- Would this kind of personal assisstant be useful for people on the autism spectrum, to help navigate the kind of implied and unspoken narratives that people with autism seem to have difficulty with?
- Would there be a call to train Duplex to speak in a way that is more comfortable for people on the spectrum?
- Or any of the neurodivergent tribes for that matter?