Re:Ask HN: What are some actual use cases of AI Agents right...
by jhbadger on Wednesday February 14, 2024 @06:01PM
(#39376801)
And the US Post Office and other postal services have been using this tech to sort letters for several decades now (although postal codes with both letters and numbers like Canada's are harder). It was viewed as the "killer app" for ML in the 1990s.
Re:Ask HN: What are some actual use cases of AI Agents right...
by PheonixPharts on Wednesday February 14, 2024 @07:07PM
(#39377374)
This thread is an object lesson in the point I'm making: people have forgotten everything we've learned about making ML based products.
Parent comment doesn't understand the concept of expectation, and this comment is apparently unfamiliar with the fact that SotA for digit recognition [0] has been much higher than 90% even in the 90s. 90% accuracy for digit recognition is what you get if you use logistic regression as your model.
My point was that numbers that look good in terms of research often aren't close to go enough for the real world. It's not that 90% works for zip codes, it's that in the 90s accuracy was closer to 99%. You have validated my point rather than rejected it.
You are assuming that the probability of failure is independent, which couldn't be further from the truth. If a digit recogniser can recognise one of your "hard" handwritten digits, such as a 4 or a 9, it will likely be able to recognise all of them.
The same happens with AI agents. They are not good at some tasks, but really really food at others.