News for hackers. Stuff that matters.
Re:A YouTube chat about chess got flagged for hate speech by crvdgc on Wednesday July 21, 2021 @11:04PM (#27914853)
Scunthorpe problem [1] is used to describe the false positives for auto filters, which are often results of naive substring matching. In a way, the current problem is similar, but on the semantic level.

However, it doesn't cover other cases for other AI mistakes you mentioned, like self-driving.

[1]: https://en.wikipedia.org/wiki/Scunthorpe_problem

Re:A YouTube chat about chess got flagged for hate speech by runarberg on Wednesday July 21, 2021 @11:40PM (#27915077)
The problem also goes in the other direction. That is platform rely too much on automation that human signal gets too faint. For example humans have a hard time flagging actual hate speech on these platforms as well. Another example: Every so often there is a front page post on HN where a company like Google will automatically shut down service for a customer (false positive). The customer has a hard time getting through and having this false positive corrected because their signal can’t reach through the layers of automation.