News for hackers. Stuff that matters.
Re:Learning from Imbalanced Classes by nl on Friday August 26, 2016 @02:44AM (#12364648)
And it's going to end up quite a bit more than that.

Check out slides 21 and 22 from [1]. There are parts that will process 4 PB/s (!)

[1] http://www.slideshare.net/SparkSummit/distributed-data-proce...

Re:Learning from Imbalanced Classes by haddr on Monday August 29, 2016 @01:43PM (#12383634)
It's not a secret that in the process of automatic manufacturing there are terabytes of data produced in a matter of minutes. OF course how many of such data is of any use is another story, but anyway it still requires storage and processing power capable of handling that volumes.