News for hackers. Stuff that matters.
Re:Malware Detection in Executables Using Neural Networks by LeoJiWoo on Monday December 04, 2017 @12:46PM (#15845791)
That is concerning. I knew over-fitting was a real issue with AI.

Still haven't found a good way to deal with high bias or high variance myself.

Re:Malware Detection in Executables Using Neural Networks by rectangletangle on Monday December 04, 2017 @12:51PM (#15845851)
Cross validating the classifier/hyper parameters and a good scoring metric (Matthews correlation coefficient) go a long way. Since the classes are very imbalanced, an appropriate scoring metric is very important. Even more importantly, train with lots of high-quality data whenever possible. Anecdotally many seem to obsess over the particular classification algorithm, while neglecting data quality. A classifier is only ever as good as its training set.