Re:Superintelligence: The Idea That Eats Smart People (2016)
by TheOtherHobbes on Wednesday November 21, 2018 @07:18AM
(#18502105)
Political troll bots are already very much a thing on FB, Twitter, and the comment sections of national media.
ML is not a good defence, because it turns out that it's incredibly easy to mimic human posting patterns. And beyond a certain volume, social proof effects take over. One dissenting human voice can easily be shouted down by ten bot voices, and this fact on its own can make the bot content more persuasive.
Likewise, I'm sure there are teams of security researchers already using ML to counteract such systems.
Both sides will evolve together as an ecosystem, in the same complex interplay of attack and defense which exists in natural ecosystems. Natural ecosystems are an arms race of continual adaption, but it's not a foregone conclusion that there will be a real winner, or that winners take all.