While I also tend to be an AI skeptic, did you actually ready this? For example, the author suggests how using confidence data that are already available, and discusses techniques for getting these across to the user.

Then suggests a measure of "controversialness" that, also, does not require pipe dream AI.

I thought this was a very insightful piece, cataloging a slew of potentially reasonable approaches aimed at a growing problem.