News for hackers. Stuff that matters.

A comment on Introducing DataFrames in Spark for Large Scale Data Science. Parent comment

Re:Introducing DataFrames in Spark for Large Scale Data Science by djcater on Tuesday February 17, 2015 @08:29PM (#9066474)
Are there any timelines for when this (and Spark in general) will fully support ORC files (including predicate-pushdown)?
[ Parent | on HN ]
Re:Introducing DataFrames in Spark for Large Scale Data Science by pwendell on Tuesday February 17, 2015 @08:32PM (#9066485)
Very likely in Spark 1.4. Hortonworks has been helping out with this, we just need some internal refacotring to the API to make it work.
[ Parent | on HN ]