Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Announcing Spark 1.6. Parent comment
I don't know if the OutOfMemory exception can still occur in recent versions of Spark, but the performance impact of groupByKey is very real.
There are no comments on this comment yet.
I don't know if the OutOfMemory exception can still occur in recent versions of Spark, but the performance impact of groupByKey is very real.