News for hackers. Stuff that matters.

A comment on AI winter is well on its way. Parent comment

Re:AI winter is well on its way by bitL on Wednesday May 30, 2018 @03:17PM (#17190782)
I was referring mainly to this one (from the same group and it actually surpassed humans on average):

https://stanfordmlgroup.github.io/projects/chexnet/

In their paper they even used "weaker" DenseNet-121 instead of DenseNet-169 for Mura/bones. DenseNet-BC I tried is another refinement of the same approach.

[ Parent | on HN ]
Re:AI winter is well on its way by timr on Wednesday May 30, 2018 @06:52PM (#17192590)
Those are some sketchy statistics. The evaluation procedure is questionable (F1 against the other 4 as ground truth? Mean of means?), and the 95% CI overlap pretty substantially. Even if their bootstrap sampling said the difference is significant, I don't believe them.

Basically, I see this as "everyone sucks, but the AI maybe sucks a little less than the worst of our radiologists, on average"

[ Parent | on HN ]