> Unrelated: one particularly dark dystopian outcome we've been wargaming is: what if someone (not us!) used decentralised rep to seed a GPT-3 style bot to locate abusive communities, and then automated the process of infiltrating & investigating them... only to then end up ascending the ranks while preserving its cover and accidentally triggered some atrocity. So, um, let's not do that.)

I think you greatly overestimate the abilities of GPT-3. GPT-3's writable memory is short-term only – its long-term memory is read-only – so by the end of a conversation, it has permanently forgotten what the topic was at the beginning. Given its lack of writable long-term memory, it is completely incapable of succeeding at any tasks involving long-term planning, such as the infiltration and investigation of a social group.

Of course, you said "GPT 3 style bot", not GPT-3, but the AI you have in mind has significantly greater capabilities than GPT-3 has, so isn't fairly said to be "GPT 3 style" at all.