News for hackers. Stuff that matters.

A comment on Apache Spark Scale: A 60 TB+ production use case. Parent comment

Re:Apache Spark Scale: A 60 TB+ production use case by tveita on Thursday September 01, 2016 @03:19PM (#12408114)
Have you run into any of the issues mentioned of the article? Some of them are regressions, which version of Spark were you running?

Out of the linked issues these all seem like they would be "easy" to hit given enough data:

https://issues.apache.org/jira/browse/SPARK-13279

https://issues.apache.org/jira/browse/SPARK-13850

https://issues.apache.org/jira/browse/SPARK-13958

https://issues.apache.org/jira/browse/SPARK-14363

[ Parent | on HN ]

There are no comments on this comment yet.