Re:DeepHeart: A Neural Network for Predicting Cardiac Health
by jisaacso on Tuesday July 26, 2016 @10:16AM
(#12165738)
The ML community has techniques for building methods to address low signal to noise, class imbalance, noisy labels and smaller sample sizes. I definitely agree, all of these are issues in medical datasets. Part of the exciting challenge at the intersection of medicine and machine learning is around scaling data collection while respecting patient privacy.
* Massive class imbalance -- we have much more data for healthy patients than for sick patients, especially at the scales required for deep learning.
* Heavy amounts of noise -- Medical imaging is a difficult feat and noise is a fact of life. Not only that, but data is hard to come by and some noise in the labels is likely.
* Long term outcomes -- trying to predict diseases or other long term results from signals is very difficult, especially when the outcome is not immediately obvious by looking at the input.
TLDR: Imagine that you have to compete in ImageNet, but the images are full of noise, half of the ones labeled "dog" are actually some sort of bird, and instead of guessing what's in the image, you're given an image and then asked to guess if that image, when painted in watercolor, will make a baby smile.