Re:The ImageNet dataset transformed AI research
by nonbel on Thursday July 27, 2017 @03:21AM
(#14863285)
The problem with a lot of medical labeling is the labels are not very consistent/accurate to begin with. Just go to three doctors with the same symptoms and see what they say...
Re:The ImageNet dataset transformed AI research
by unityByFreedom on Thursday July 27, 2017 @06:00AM
(#14863889)
That is surmountable. You can use annotator agreement, and, algorithms don't need perfectly labeled data in order to improve.
Any effort to create additional medical datasets would probably help enhance machine learning diagnostics.
The data that you want to be perfect is the test set, which is smaller than training sets.
I'm not saying it's easy on any front. It is possible, and it would be hugely beneficial to humans to have such a dataset. Raising awareness about the problem may be one step towards solving it.