Ask HN: Why not ban first-person pronouns from conversational AI?
Conversational AI presents (non-IT) people with the powerful illusion that it is conscious. (I personally have a friend who argues vehemently that ChatGPT is conscious - admittedly, he has a diagnosed mental illness, but still.) People become emotionally attached, over-trust it and rely on it for guidance. I understand teenagers are particularly prone to this. Real social interactions...