Algorithm accurately predicts when teens have suicidal thoughts, behavior

Re:Algorithm accurately predicts when teens have suicidal th... by cweill on Friday November 05, 2021 @03:53PM (#29124023)

Agreed. ROC AUC is fairly robust to over or undersamping a class in determining if your classifier is predictive.

[ Parent | on HN ]

Re:Algorithm accurately predicts when teens have suicidal th... by aabaker99 on Friday November 05, 2021 @04:38PM (#29124482)

See my sibling comment. Suppose you have data with 0.95 positive class and 0.05 negative class. You can achieve high ROC AUC with the classifier that blindly predicts the positive class. It may be "predictive" (after all 0.95 of the data is positive), but I would hesitate to praise such a classifier.

[ Parent | on HN ]