News for hackers. Stuff that matters.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by woeirua on Monday November 30, 2020 @11:37AM (#25255631)
We’d have to see the distribution of GDT scores evaluated on unknown proteins to say anything about how confident we can be. If the distribution is tightly distributed around the median then great, this works really well. If the variance is large though then you’re going to have a hard time using this for meaningful predictions.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by foota on Monday November 30, 2020 @11:41AM (#25255680)
According to the article there's a confidence score as well. As long as this is sufficiently predictive of errors either a tight or wide distribution is likely acceptable.
Re:AlphaFold: a solution to a 50-year-old grand challenge in... by woeirua on Monday November 30, 2020 @11:50AM (#25255808)
We need to see the relationship between confidence and GDT score. If you have a nice relationship then again everything is great. But... most confidence metrics from neural networks do not have a nice relationship to the primary metric.