I couldn't think of a better criteria of success when automating something.

Only that more than half of the time a peaceful discussion gets buried by that automated system and then dang comes several hours later and says "oooops this got caught by the anti-flamewar system and now the discussion is dead!! oops!! our code monkeys are working hard to fix this!"