News for hackers. Stuff that matters.

A comment on Announcing Apache Spark 1.1. Parent comment

Re:Announcing Apache Spark 1.1 by ambrood on Friday September 12, 2014 @04:34PM (#8310297)
Don't the SchemaRDD already support Parquet? Although it'd be great if they supported CSVs.
[ Parent | on HN ]
Re:Announcing Apache Spark 1.1 by JoshRosen on Friday September 12, 2014 @05:21PM (#8310533)
There's work in progress to support importing CSV data as SchemaRDDs:

https://issues.apache.org/jira/browse/SPARK-2360 https://github.com/apache/spark/pull/1351

[ Parent | on HN ]