News for hackers. Stuff that matters.
Re:Rite Aid banned from using face recognition software afte... by crazygringo on Wednesday December 20, 2023 @10:42AM (#38709862)
Which is precisely why you combine the two systems.

If humans get it wrong 15% of the time, that means they're reducing false positives by 85%.

That's the whole point of combining facial recognition with human review.

You still have to decide what to do with that final information considering that it's still not perfect.

But you should never be relying on facial recognition by itself. Even if humans are imperfect, they still improve the accuracy, and can make the final call "nope I'm just not sure, I'm not going to take action".

Re:Rite Aid banned from using face recognition software afte... by sokoloff on Wednesday December 20, 2023 @10:52AM (#38709995)
The error reduction from applying a different system applies if the source of the error does not manifest itself in both systems (if errors are uncorrelated, you can get an improvement that looks like that implied by the simple application of statistics, but not if they are correlated).

As an example, you can combine human review with automatic facial detection of identical twins and likely not see much (any?) reduction in error rate at all.

Two independent "85% accurate" humans are not 97.7% accurate for identical twins either.

Re:Rite Aid banned from using face recognition software afte... by ProjectArcturis on Wednesday December 20, 2023 @10:50AM (#38709967)
The question is how correlated are human and machine errors. I would guess fairly strongly, in which case human review would add little additional accuracy.
Re:Rite Aid banned from using face recognition software afte... by crazygringo on Wednesday December 20, 2023 @10:55AM (#38710028)
> I would guess fairly strongly

No, evidence suggests they are not. We're all very aware of the horror stories of AI misidentifying species. Different AI systems are different, but in general AI seems to make quite different classes of mistakes from humans. Our brains work very differently from current statistical models.

So human review absolutely adds accuracy, you can generally assume. And it adds human-accountable judgment which is just as important.

Re:Rite Aid banned from using face recognition software afte... by ProjectArcturis on Thursday December 21, 2023 @10:21AM (#38721506)
Ultimately it's an empirical question, and unless someone has published the research, you and I will not be able to know for sure. I think there will be a lot of cases where two people simply look a lot alike, and any observer would have difficulty distinguishing them.