Highly unlikely. It's pretty much impossible to detect the difference between a friendly banter, a heated debate, trolling, and genuine harassment for most people given just a chat log.

There's often much more information required (prior communication history of the involved parties, previous activities in other chats, etc.).

Using automated systems like GPT-3 would simply lead to people switching to different languages (not in the literal sense, but using creative metaphors and inventing new slang).

Pre-canned "AI" is unable to adapt and learn and I doubt that any form of AGI (if even possible without embodiment) that isn't capable of real-time online learning and adapting would be up to the task.

Mmh I'm not convinced. There is pattern in aggressiveness. One of them being the harasser is talking about the victim or something that's strongly linked to the victim (like it's work, member of familly, etc).

We can, though the teams I know who are doing it are not using GPT-3. If you look at any platform that has live chat features (think Instagram Live or Twitch) and an ML team, then there is almost certainly someone working on toxicity filtering along with propaganda detection etc. It's a really really hard problem, particularly when you think about how chat platforms tend to develop their own short hand and slang.

A double bind detector!