The seeds of a new romantic comedy
...
Dan: I'm not exactly who I say I am. My profile picture is actually of an AI, not a real person. But I've really enjoyed talking to you and I wanted to be honest with you before we meet in person.
Girl: Wait, what? You're an AI? That's really weird. Why would you do that?
Dan: I know it's weird, but I wanted to see if someone could like me for who I am, not just because of what I look like. And I have to say, I really enjoyed our conversations. But I understand if you don't want to meet anymore.
Girl: stay away from me...
... Three months later....
Girl: Hi...I've been thinking...
No way to be sure they weren't manual, just looking at some of the chats my friends shared, they were well within the realm of what could be achieved with GPT-2 level systems. And mostly echoing the sentiments my friends were expressing, or escalating the conversation in fairly stereotypical ways. Most dating chat / sexting is pretty superficial initially. If this isn't automated already, it's purely due to lack of sophistication on the part of the attackers, there's no technical issue.
Imagine an online poker or slots game that proposes to add verisimilitude by including AI chatter from the other players at the table, but they're all running an ML model trained on optimizing for destructive and addictive behaviors.
Picture a Club Penguin type game for kids, but the NPCs give the kids detailed instructions about how to steal their parents' credit card numbers to buy funny money.
And then there's the obvious issue of Gamergate style troll antics being automated and deployed at scale, maybe even with nation state backed botnets to help. With smaller botnets you could even cyberbully at scale, sending your least favorite game developer or reality TV star a bunch of messages to harm themselves.