I love this idea. Alongside factual_error_bot it would completely transform political discourse.

Imagine if presidential debates had real-time scoring of what was being said. Politifact is great, but 24h delay makes it substantially less impactful.

People already use bots to harass their opponents on twitter, etc. It's not a good thing. This sounds good for a short while, but think through how misguided or malicious people would use it.

Do you know of any data sets of examples of logical fallacies?

Your logical fallacy is: Just because we can doesn't mean we should.

That's what my experience indicates, anyway ;)