News for hackers. Stuff that matters.
Re:Ask YC: This is our tech, how can we make this into a pro... by andrewljohnson on Sunday October 17, 2010 @04:22PM (#1801316)
Hmm, yeah... good point on that. I'll leave my comment, but I take it back :)
Re:Ask YC: This is our tech, how can we make this into a pro... by anmol on Sunday October 17, 2010 @04:36PM (#1801348)
With severely unbalanced classes, overall accuracy is not a good metric. So we use recall of the symptom class, and how it varies with the precision. Recall = 0.6 to 0.9. All results are based on cross-validation.

There is a lot more sophistication we can add (e.g. markov properties), these are almost first-order results.

Nonetheless important to validate with other populations. That would be a big part of testing any product.