https://www.theverge.com/2018/11/22/18107885/china-facial-re... https://you.com/search?q=facial+recognition+in+china
- 440 images of congressmen
- 1,756 mugshots
- 10 mismatches (?) with 70+% certainty
The highest was 86%, but to be fair, I wouldn't be able to tell you confidently for all of them that the convicts aren't the same person. And under 80% should be suspect anyway. It's just that you need to use the right statistical methods when comparing a person to a large pool because you'll have spurious matches.
https://mleverything.substack.com/p/how-facial-recognition-w...
This attitude disturbs me more than any other single aspect of the mass idiocy around adopting AI for critical things. 80% is horribly low accuracy for anything even remotely important.
For example, imagine you went to a store and could tell the cashier any price for anything so long as it was 80% accurate, as in, 80% of the original price. Just a 20% potential discount, nbd.
Or put another way, 80% of your items had to have a perfectly accurate price but you bought 5 items, 1 of them was a PlayStation 5 you priced at $1. It's fine. The rest were accurate!
80% is extremely low accuracy. It's absurd to think that's a good level to cut things off. We should demand systems like these demonstrate 99% or better accuracy. Until then they should be illegal to apply in any scenario where a decision is made about another person.
Even the sunglasses, beard, face paint, bad lighting or puberty didn't throw off the model.
The open source dlib model was considerably worse, but AWS Rekognition was incredible
https://mleverything.substack.com/p/how-facial-recognition-w...