News for hackers. Stuff that matters.
Re:Good Machine Learning Practice for Medical Device Develop... by 5440 on Sunday November 20, 2022 @11:04PM (#33688614)
I think those are generally good questions but the majority of submissions that FDA CDRH are reviewing are for imaging of ultrasound, MRI, XRAY etc, with a sprinkling of audio AI and maybe some individualized vaccines predictions at CDER.

These questions are generally addressed during the pre-sub for each FDA submission but I agree that the demographic information could be pretty infinite. I'm working on at least 5 of these AI submissions per week.

For example, lets say you have an AI submission for identifying cardiac ultrasound images. FDA will ask for very specific demographic information in the training and performance tests, as well as comorbidities (such as hypertension) for each training image. In addition, they will want at least three physicians to annotate the images. The training dataset is likely to contain at least 100-200K images.

Re:Good Machine Learning Practice for Medical Device Develop... by edge17 on Sunday November 20, 2022 @11:51PM (#33688920)
If three physicians are annotating 100-200k images, how much does that cost?
Re:Good Machine Learning Practice for Medical Device Develop... by snowpid on Monday November 21, 2022 @04:42AM (#33690704)
One startup from Hamburg that I know uses medical students for this, and from what I always hear, their training dataset is their most valuable asset.
Re:Good Machine Learning Practice for Medical Device Develop... by ware_am_i on Monday November 21, 2022 @12:54AM (#33689319)
It's cool to see another FDA AI Regulatory person on HN. Drop me a note if you are interested in connecting -> [email protected]