News for hackers. Stuff that matters.

A comment on We can all be AI engineers – and we can do it with open source models. Parent comment

Re:We can all be AI engineers – and we can do it with open s... by btdmaster on Thursday November 14, 2024 @05:48PM (#42142040)
What does 50% precision mean in this case? I know 50% accuracy might mean P(fraud_predicted | fraud) = 50%, but I don't understand what you mean by precision?
[ Parent | on HN ]
Re:We can all be AI engineers – and we can do it with open s... by chychiu on Thursday November 14, 2024 @06:24PM (#42142377)
Precision = True Positive / (True Positive + False Positive) = 1 - False Positive Rate

On that note, I'm surprised the precision / recall for fin models are 80% / 50%

[ Parent | on HN ]
Re:We can all be AI engineers – and we can do it with open s... by disgruntledphd2 on Friday November 15, 2024 @06:26AM (#42145938)
They are obviously relatively low stakes, otherwise I'd be super worried.
[ Parent | on HN ]