News for hackers. Stuff that matters.
Re:Ask HN: Any open source code/materials on predicting futu... by mc32 on Thursday December 21, 2017 @11:47AM (#15980366)
So if the AI identifies insider trading at trading firms, banks, etc., we should beware that this would create a feedback loop to look more into the investment and banking sectors and will ignore the mom and pop insider traders? That they go where crime is rampant over where it isn't and that could be a bad thing?
Re:Ask HN: Any open source code/materials on predicting futu... by bcyn on Thursday December 21, 2017 @11:53AM (#15980438)
I think it's not inherently bad to have a bias, but it's bad if you don't recognize it. In your example:

If you train an AI on data that solely consists of trading firms & banks, you should recognize that it's an AI biased towards detecting activity at trading firms & banks, and that it might be lacking in other areas.

It becomes dangerous when such an AI is marketed and assumed as unbiased and the source of truth for detecting all insider trading activity.

Re:Ask HN: Any open source code/materials on predicting futu... by mc32 on Thursday December 21, 2017 @12:28PM (#15980782)
If we don't have infinite resources (prosecutorial, for example), it makes sense to concentrate on the most salient loci of crime. If after enough resources are devoted to the most egregious locus, a different locus becomes the focus of crime and in turn gets the attention, that's not a bad thing...

In other words if done decently well, they'd obtain data from all places but focus on the problematic areas till they reach equilibrium and then you redirect to the next hotspot, no?

Re:Ask HN: Any open source code/materials on predicting futu... by evgen on Thursday December 21, 2017 @02:02PM (#15981751)
Is it a loci because that is where the crime happens, or is it a loci because that is where all of the crime prevention/detection/prosecution is directed due to external circumstances? You have to be able to correct for this sort of bias in your training data or else you are just baking the external circumstances into the model and pretending that they reflect reality. Start by figuring out how you would obtain data from all places first.
Re:Ask HN: Any open source code/materials on predicting futu... by otakucode on Thursday December 21, 2017 @12:39PM (#15980884)
Mom and pop insider trading? How would that work, exactly? Or was it intended as a joke?
Re:Ask HN: Any open source code/materials on predicting futu... by mc32 on Thursday December 21, 2017 @12:55PM (#15981062)
Small fry. People like Martha Stewart. She's wealthy of course, but her dipping in is of little consequence. Or your buddy at Google lets you in on something theyre not supposed to. It's the big sharks you care about.